-- Logs begin at Tue 2022-07-19 11:51:32 UTC, end at Tue 2022-07-19 13:18:55 UTC. -- Jul 19 12:22:19.608674 dv-cinder-820994-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 12:22:19.619810 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 12:22:19 2022] *** Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: nodename: dv-cinder-820994-4-iscsi Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: machine: x86_64 Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: clock source: unix Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: pcre jit disabled Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: detected number of CPU cores: 4 Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: current working directory: / Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: detected binary path: /usr/bin/uwsgi-core Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: your processes number limit is 47680 Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: your memory page size is 4096 bytes Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: detected max file descriptor number: 2048 Jul 19 12:22:19.621806 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: lock engine: pthread robust mutexes Jul 19 12:22:19.622662 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: thunder lock: enabled Jul 19 12:22:19.622662 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 12:22:19.622662 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 12:22:19.666381 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: Python main interpreter initialized at 0x5650c1e919c0 Jul 19 12:22:19.666381 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: python threads support enabled Jul 19 12:22:19.666381 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: your server socket listen backlog is limited to 100 connections Jul 19 12:22:19.666381 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: your mercy for graceful operations on workers is 90 seconds Jul 19 12:22:19.666688 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 12:22:19.666785 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: *** Operational MODE: preforking *** Jul 19 12:22:19.667048 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: *** uWSGI is running in multiple interpreter mode *** Jul 19 12:22:19.667048 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: spawned uWSGI master process (pid: 103146) Jul 19 12:22:19.667245 dv-cinder-820994-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 12:22:19.667778 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: spawned uWSGI worker 1 (pid: 103147, cores: 1) Jul 19 12:22:19.668105 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: spawned uWSGI worker 2 (pid: 103148, cores: 1) Jul 19 12:22:19.668281 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 12:22:20.318546 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 12:22:20.327977 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 12:22:21.434143 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:22:21.434143 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Jul 19 12:22:21.434735 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:22:21.434735 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Jul 19 12:22:21.435809 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:22:21.435809 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: from cryptography.utils import int_from_bytes Jul 19 12:22:21.436287 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:22:21.436287 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: from cryptography.utils import int_from_bytes Jul 19 12:22:23.902750 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 12:22:23.903265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 12:22:23.903608 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 12:22:23.903705 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 12:22:23.903800 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 12:22:23.903891 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 12:22:23.903972 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 12:22:23.904052 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 12:22:23.904142 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 12:22:23.904258 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 12:22:23.904419 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.904541 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.904739 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.904829 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.905055 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.905144 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.905367 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.905458 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.905689 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.905777 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.905993 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.906096 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.906309 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.906399 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.906622 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.906716 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.906945 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.907042 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.907201 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.907289 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.907508 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.908117 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.908399 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-4-iscsi {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.908499 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-4-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.908726 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.908815 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.909038 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.909124 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.909340 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.909428 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.909653 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.909740 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.909952 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.910053 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.910268 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.910364 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.910567 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.910655 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.911054 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.911168 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.912384 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.912589 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.912589 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.912963 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.913126 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.913356 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.913509 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.913738 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.913891 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.914077 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.914312 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.914491 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.914650 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.914836 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.915066 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.915255 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.915459 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.915612 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.915797 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.916013 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.916222 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-4-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.916404 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-4-iscsi {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.916607 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.916796 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.916993 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.917171 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.917330 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.917484 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.917611 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.917777 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.917985 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.918138 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.918273 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.918419 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.918627 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.918796 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.918927 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919063 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919195 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919333 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919466 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919603 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919729 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919853 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.919978 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.920112 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.920296 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.920423 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.920547 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.920673 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.920807 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.920942 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921068 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921202 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921334 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921461 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921611 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921739 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921863 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.921994 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.922126 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.922252 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.922389 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.922515 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.922640 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.922799 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.922961 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.923096 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.923231 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.923981 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.924110 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.924270 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.924399 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.924549 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.924677 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.924811 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.924937 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925063 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925201 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925327 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925451 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925582 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925708 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925839 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.925975 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926100 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926224 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926348 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926472 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926595 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926729 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926865 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.926991 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.927125 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.927250 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.927385 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.927519 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.927653 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.927786 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.927918 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928052 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928201 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928329 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928464 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928609 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928609 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928855 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.928988 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.929114 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.929114 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.929357 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.929493 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.929627 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.929627 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.929881 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930007 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930140 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930266 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930390 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930528 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930671 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930796 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.930921 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931044 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931178 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931302 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931434 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931566 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931691 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931815 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.931951 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.932082 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.932262 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.932397 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.932523 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.932655 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.932789 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.932789 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933023 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933023 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933257 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933381 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933513 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933638 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933761 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.933885 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934020 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934145 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934283 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934421 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934547 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934670 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934800 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.934934 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935067 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935192 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935317 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935448 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935574 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935714 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935848 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.935973 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.936104 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.936241 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.936369 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.936562 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.936693 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.936875 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.937005 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.937176 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.937312 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.937475 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.937618 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.937773 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.937917 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.938072 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.938206 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.938378 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.938521 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.938677 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.938796 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.939003 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.939131 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.939319 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.939456 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.939619 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.939748 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.939918 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.940047 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.940241 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.940386 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.940543 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.940672 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.940843 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.940972 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.941148 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.941276 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.941447 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.941584 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.941747 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.941952 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.942087 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.942211 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.942334 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.942458 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.942628 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.942775 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.942924 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.943053 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.943221 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.943357 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.943518 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.943656 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.943815 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.943953 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.944108 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.944285 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.944425 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.944562 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.944706 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.944840 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.945004 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.945132 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.945321 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.945458 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.945620 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.945748 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.945920 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.946048 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.946217 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.946347 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.946519 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.946646 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.946838 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:22:23.946974 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.947165 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.947294 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.947495 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.947621 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.947802 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.947929 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.948129 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.948282 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.948486 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.948615 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.948818 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.948961 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.949134 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.949270 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.949445 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.949572 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.949757 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.949895 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.950081 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.950216 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.950385 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.950514 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.950689 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.950827 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.950995 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.951132 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.951307 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.951434 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.951620 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.951764 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.951929 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.952056 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.952260 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.952392 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.952573 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.952716 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.952879 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.953008 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.953186 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.953304 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.953502 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.953645 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.953813 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.953941 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.954118 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.954256 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.954428 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.954557 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.954792 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.954928 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.955097 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.955226 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.955453 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.955583 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.955772 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.955901 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.956082 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.956233 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.956414 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.956545 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.956722 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.956848 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.957035 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.957173 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.957357 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.957485 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.957663 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.957791 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.957976 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.958114 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.958284 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.958421 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.958592 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.958720 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.958895 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.959023 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.959203 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.959338 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.959506 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.959634 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.959814 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.959950 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.960134 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.960317 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.960471 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.960600 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.960780 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.960925 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.961088 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.961216 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.961401 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.961530 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.961709 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.961838 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.962016 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.962144 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.962321 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.962449 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.962622 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.962752 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.962922 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.963051 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.963225 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.963352 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.963523 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.963653 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.963828 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.963954 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.964147 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.964308 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.964515 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.964642 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.964792 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.964930 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.965096 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.965240 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.965405 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.965534 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.965714 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.965841 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.966017 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.966155 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.966318 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.966448 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.966621 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.966749 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.966926 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.967063 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.967227 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.967357 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.967530 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.967657 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.967839 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.967978 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.968139 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.968321 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.968466 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.968591 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.968767 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.968897 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.969066 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.969195 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.969368 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.969495 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.969673 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.969802 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.969979 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.970622 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.970823 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.970953 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.971132 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.971262 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.971441 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.971568 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.971750 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.971877 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.972062 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.972215 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.972396 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.972534 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.972728 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.972865 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.973030 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.973162 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.973349 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.973468 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.973666 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.973806 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.973979 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.974109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.974279 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.974408 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.974583 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.974720 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.974881 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.975009 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.975180 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.975310 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.975481 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.975619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.975781 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.975910 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.976078 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.976230 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.976402 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.976546 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.976701 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.976838 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.977001 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.977128 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.977282 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.977412 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.977583 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.977717 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.977890 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.978015 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.978187 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.978321 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.978486 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.978615 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.978784 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.978913 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.979087 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.979207 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.979410 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.979538 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.979721 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.979860 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.980062 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.980225 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.980398 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.980537 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.980718 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.980860 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.981025 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.981154 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.981334 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.981465 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.981640 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.981783 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.981947 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.982074 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.982250 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.982385 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.982556 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.982695 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.982863 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.982990 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.983167 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.983294 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.983480 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.983610 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.983785 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.983913 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.984090 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.984248 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.984421 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.984550 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.984734 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.984863 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.985032 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.985154 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.985342 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.985470 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.985657 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.985825 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.986050 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.986179 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.986367 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.986496 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.986685 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.986813 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.986989 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.987124 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.987299 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.987430 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.987604 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.987734 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.987907 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.988083 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.988267 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.988397 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.988528 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.988654 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.988828 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.988971 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.989133 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.989263 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.989441 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.989583 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.989742 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.989871 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.990311 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.990456 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.990619 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.990747 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.990932 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.991071 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.991233 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.991369 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.991542 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.991677 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.991860 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.992000 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.992200 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.992345 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.992514 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.992650 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.992820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.992950 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.993133 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.993260 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.993436 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.993572 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.993762 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.993900 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.994035 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.994161 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.994319 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.994449 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.994618 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.994748 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.994922 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.995058 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.995227 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.995354 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.995527 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.995655 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.995830 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.995959 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.996131 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.996300 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.996461 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.996589 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.996760 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.996888 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.997059 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.997202 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.997358 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.997485 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.997661 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.997789 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.997970 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.998113 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.998273 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.998401 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.998588 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.998717 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.998903 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.999034 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.999204 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.999335 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.999504 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.999633 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.999808 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:23.999927 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.000112 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.000258 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.000436 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.000577 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.000737 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.000867 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.001037 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.001166 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.001848 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.001991 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.002196 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.002326 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.002500 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.002635 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.002802 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.002930 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.003117 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.003247 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.003422 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.003550 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.003731 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.003866 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.004037 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.004244 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.004389 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.004516 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.004648 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.004788 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.004968 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.005097 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.005270 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.005396 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.005574 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.005712 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.005879 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.006007 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.006185 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.006321 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.006491 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.006628 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.006800 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.006929 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.007101 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.007229 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.007407 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.007536 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.007712 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.007840 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.008013 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.008149 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.008338 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.008474 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.008650 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.008780 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.008964 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.009214 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.009524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.009654 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.009841 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.010012 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.010140 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.010275 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.010459 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.010597 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.010774 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.010912 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.011089 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.011225 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.011411 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.011539 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.011739 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.011875 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.012039 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.012198 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.012378 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.012522 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.012682 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.012812 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.012984 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.013111 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.013289 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.013416 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.013590 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.013721 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.013892 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.014022 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.014194 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.014334 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.014497 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.014625 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.014797 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.014926 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.015096 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.015234 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.015393 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.015522 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.015692 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.015828 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.015997 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.016137 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.016336 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.016463 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.016611 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.016740 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.016912 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.017103 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.017289 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.017417 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.017612 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.017741 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.017942 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.018071 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.018197 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.018331 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.018501 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.018631 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.018805 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.018935 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.019146 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.019276 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.019451 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.019574 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.019786 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.019916 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.020116 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.020265 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.020481 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.020609 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.020781 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.020912 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.021086 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.021215 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.021389 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.021526 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.021687 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.021815 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.021985 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.022114 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.022289 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.022435 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.022596 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.022724 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.022891 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.023018 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.023195 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.023332 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.023494 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.023632 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.023797 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.023926 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.024099 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.024259 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.024424 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.024554 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.024728 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.024856 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.025023 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.025151 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.025329 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.025457 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.025632 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.025761 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.025931 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.026061 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.026231 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.026368 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.026532 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.026660 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.026832 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.026960 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.027132 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.027260 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.027434 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.027560 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.027729 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.027869 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.028036 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.028163 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.028359 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.028505 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.028662 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.028792 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.028962 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.029090 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.029264 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.029401 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.029564 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.029692 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.029863 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.029992 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.030163 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.030299 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.030473 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.030602 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.030774 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.030911 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.031074 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.031212 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.031376 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.031517 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.031674 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.031814 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.031973 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.032104 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.032297 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.032425 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.033129 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.033265 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.033460 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.033592 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.033777 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.033908 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.034081 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.034218 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.034388 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.034517 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.034688 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.034816 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.034987 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.035119 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.035285 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.035420 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.035581 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.035709 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.035878 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.036018 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.036186 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.036315 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.036497 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.036635 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.036777 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.036917 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.037087 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.037215 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.037392 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.037519 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.037690 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.037838 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.037989 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.038119 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.038286 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.038415 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.038586 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.038726 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.038911 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.039046 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.039217 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.039343 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.039552 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.039682 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.039864 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.039991 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.040196 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.040319 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.040508 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.040637 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.040815 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.040945 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.041123 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.041258 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.041420 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.041549 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.041727 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.041854 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.042032 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.042167 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.042340 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.042476 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.042638 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.042764 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.042940 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.043066 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.043242 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.043380 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.043552 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.043680 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.043858 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.043996 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.044165 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.044350 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.044503 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.044631 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.044823 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.044966 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.045125 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.045254 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.045429 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.045559 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.045734 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.045872 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.046038 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.046170 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.046341 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.046471 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.046643 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.046846 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.046973 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.047096 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.047242 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.047383 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.047545 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.047674 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.047849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.047979 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.048152 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.048405 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.048550 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.048685 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.048811 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.048936 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.049120 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.049248 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.049419 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.049555 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.049722 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.049849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.050033 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.050168 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.050332 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.050461 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.050633 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.050753 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.050929 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.051066 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.051232 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.051359 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.051528 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.051663 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.051837 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.051965 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.052266 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.052409 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.052574 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.052704 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.052875 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.053015 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.053177 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.053304 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.053479 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.053615 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.053787 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.053924 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.054095 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.054235 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.054396 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.054532 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.054697 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.054826 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.055101 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.055228 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.055406 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.055542 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.055711 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.055841 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.056012 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.056140 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.056335 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.056467 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.056636 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.056764 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.056945 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.057084 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.057245 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.057372 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.057543 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.057674 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.057840 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.057977 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.058140 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.058280 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.058444 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.058571 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.058752 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.058879 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.059073 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.059212 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.059452 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.059589 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.059752 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.059890 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.060078 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.060271 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.060481 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.060608 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.060788 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.060917 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.061110 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.061246 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.061426 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.061561 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.061745 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.061873 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.062044 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.062175 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.062354 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.062496 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.062660 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.062798 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.062966 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.063093 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.063289 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.063419 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.063592 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.063720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.064466 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.064600 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.064772 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.064904 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.065086 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.065214 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.065403 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.065538 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.065714 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.065852 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.066026 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.066153 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.066350 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.066481 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.066740 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.066876 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.067045 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.067175 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.067360 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.067499 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.067678 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.067806 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.067976 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.068104 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.068313 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.068460 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.068615 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.068743 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.068912 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.069040 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.069212 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.069355 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.069514 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.069651 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.069817 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.069945 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.070120 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.070251 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.070425 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.070554 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.070727 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.070857 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.071026 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.071163 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.071324 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.071463 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.071624 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.071752 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.071928 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.072056 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.072259 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.072388 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.072569 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.072699 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.072884 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.073012 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.073198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.073326 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.073503 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.073632 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.073807 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.073943 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.074112 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.074241 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.074422 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.074563 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.074729 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.074859 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.075034 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.075164 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.075337 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.075476 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.075677 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.075809 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.075981 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.076110 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.076322 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.076466 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.076653 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.076783 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.077008 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.077141 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.077276 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.077402 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.077611 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.077748 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.077923 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.078052 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.078238 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.078376 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.078553 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.078681 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.078851 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.078980 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.079150 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.079289 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.079473 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.079631 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.079815 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.079943 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.080115 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.080265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.080441 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.080583 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.080746 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.080886 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.081043 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.081171 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.081341 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.081471 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.081640 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.081778 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.081941 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.082083 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.082247 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.082383 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.082562 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.082699 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.082864 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.082992 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.083161 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.083292 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.083467 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.083605 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.083764 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.083894 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.084066 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.084232 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.084413 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.084543 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.084726 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.084852 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.085042 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.085170 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.085360 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.085490 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.085680 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.085809 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.085985 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.086114 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.086292 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.086420 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.086604 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.086746 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.086900 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.087027 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.087209 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.087340 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.087517 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.087646 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.087824 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.087966 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.088129 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.088286 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.088432 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.088560 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.088741 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.088886 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.089052 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.089181 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.089360 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.089490 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.089671 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.089809 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.089987 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.090183 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.090506 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.090636 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.090816 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.090959 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.091123 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.091252 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.091429 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.091559 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.091736 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.091866 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.092041 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.092169 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.092360 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.092495 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.092661 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.092792 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.092966 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.093096 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.093270 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.093399 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.093606 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.093735 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.093890 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.094019 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.094209 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.094349 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.094533 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.094660 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.094842 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.094977 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.095683 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.095826 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.095995 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.096133 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.096327 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.096457 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.096642 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.096780 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.096974 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.097103 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.097276 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.097405 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.097585 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.097723 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.097895 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.098032 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.098203 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.098332 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.098509 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.098639 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.098813 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.098944 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.099122 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.099263 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.099425 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.099567 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.099731 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.099861 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.100036 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.100220 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.100349 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.100473 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.100664 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.100793 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.100980 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.101192 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.101321 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.101455 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.101595 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.101731 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.101904 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.102036 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.102214 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.102342 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.102524 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.102653 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.102838 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.103039 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.103351 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.103478 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.103667 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.103802 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.103997 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.104127 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.104342 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.104473 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.104655 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.104794 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.104968 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.105097 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.105283 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.105410 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.105582 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.105719 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.105884 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.106013 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.106190 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.106319 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.106494 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.106636 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.106795 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.106924 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.107096 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.107223 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.107404 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.107541 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.107701 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.107830 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.108007 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.108141 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.108335 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.108478 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.108648 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.108863 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.109183 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.109312 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.109502 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.109631 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.109824 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.109955 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.110145 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.110276 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.110459 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.110588 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.110786 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.110917 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.111130 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.111258 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.111449 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.111579 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.111753 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.111883 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.112060 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.112220 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.112388 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.112518 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.112687 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.112817 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.112986 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.113128 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.113289 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.113427 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.113597 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.113735 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.113896 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.114040 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.114200 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.114336 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.114493 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.114629 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.114802 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.114939 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.115365 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.115494 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.115669 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.115807 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.115971 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.116101 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.116299 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.116429 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.116597 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.116727 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.116896 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.117035 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.117196 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.117333 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.117496 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.117627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.117799 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.117927 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.118097 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.118225 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.118401 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.118537 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.118700 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.118830 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.119002 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.119129 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.119302 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.119442 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.119606 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.119736 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.119913 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.120041 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.120279 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.120426 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.120584 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.120722 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.120885 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.121022 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.121190 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.121331 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.121494 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.121622 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.121802 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.121939 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.122107 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.122249 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.122411 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.122541 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.122730 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.122857 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.123054 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.123192 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.123382 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.123590 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.123913 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.124044 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.124253 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.124386 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.124581 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.124709 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.124908 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.125048 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.125215 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.125346 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.125519 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.125648 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.125822 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.125951 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.126128 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.126258 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.126972 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.127102 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.127283 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.127422 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.127591 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.127721 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.127899 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.128028 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.128223 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.128370 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.128536 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.128665 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.128844 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.128979 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.129149 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.129286 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.129456 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.129585 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.129761 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.129891 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.130067 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.130195 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.130371 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.130499 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.130676 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.130803 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.131003 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.131131 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.131280 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.131411 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.131613 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.131740 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.131924 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.132054 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.132257 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.132389 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.132572 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.132715 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.132881 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.133010 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.133188 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.133316 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.133498 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.133636 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.133804 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.133932 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.134113 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.134242 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.134427 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.134570 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.134759 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.134889 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.135072 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.135200 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.135380 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.135522 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.135798 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.135934 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.136114 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.136259 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.136455 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.136585 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.136763 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.136893 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.137072 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.137207 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.137390 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.137519 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.137695 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.137833 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.138007 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.138143 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.138312 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.138440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.138626 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.138755 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.138957 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.139095 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.139279 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.139408 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.139599 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.139742 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.139901 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.140040 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.140219 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.140353 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.140523 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.140652 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.140828 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.140974 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.141140 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.141276 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.141443 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.141571 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.141742 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.141873 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.142097 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.142237 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.142411 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.142540 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.142713 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.142844 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.143013 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.143143 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.143312 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.143442 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.143614 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.143743 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.143917 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.144045 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.144240 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.144370 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.144543 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.144672 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.144841 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.144971 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.145140 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.145272 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.145440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.145567 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.145736 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.145871 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.146036 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.146174 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.146331 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.146460 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.146630 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.146771 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.146928 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.147073 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.147229 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.147359 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.147527 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.147657 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.147828 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.147965 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.148158 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.148331 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.148493 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.148621 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.148812 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.148942 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.149116 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.149247 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.149431 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.149559 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.149732 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.149860 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.150048 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.150178 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.150364 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.150494 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.150670 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.150801 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.150973 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.151102 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.151283 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.151411 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.151586 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.151715 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.151891 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.152021 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.152210 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.152356 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.152522 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.152658 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.152869 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.153014 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.153141 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.153281 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.153431 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.153559 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.153754 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.153882 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.154055 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.154199 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.154373 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.154503 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.154683 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.154811 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.154997 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.155135 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.155306 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.155443 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.155613 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.155743 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.155922 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.156059 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.156258 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.156405 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.156568 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.156698 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.156875 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.157005 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.157180 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.157310 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.157486 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.158136 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.158322 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.158450 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.158626 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.158755 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.158933 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.159071 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.159242 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.159369 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.159550 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.159678 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.159864 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.160068 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.160252 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.160392 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.160519 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.160651 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.160810 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.160941 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.161134 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.161265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.161459 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.161587 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.161773 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.161902 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.162109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.162237 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.162432 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.162560 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.162741 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.162873 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.163050 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.163180 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.163351 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.163481 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.163616 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 12:22:24.163743 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:22:24.163903 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 12:22:24.225417 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Registered counter for database nova_api Jul 19 12:22:24.225585 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Registered counter for database nova_api Jul 19 12:22:24.337694 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.340637 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.344084 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.347718 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.399811 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.context [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce8bd2-84ca-4c65-9066-7f515d1d3ee5(cell1) {{(pid=103147) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 12:22:24.402209 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.context [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce8bd2-84ca-4c65-9066-7f515d1d3ee5(cell1) {{(pid=103148) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 12:22:24.403796 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:22:24.405350 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:22:24.406134 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:22:24.406425 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:22:24.408690 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:22:24.408816 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:22:24.409598 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:22:24.410728 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Registered counter for database nova_cell0 Jul 19 12:22:24.411850 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:22:24.413905 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Registered counter for database nova_cell0 Jul 19 12:22:24.414524 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Registered counter for database nova_cell1 Jul 19 12:22:24.417807 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Registered counter for database nova_cell1 Jul 19 12:22:24.423530 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.424331 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.425107 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.428569 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.429093 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.430545 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.568642 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.569911 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.577452 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Registered counter for database nova_cell0 Jul 19 12:22:24.578555 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Registered counter for database nova_cell0 Jul 19 12:22:24.586650 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.588417 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:22:24.591036 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.592886 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:22:24.923849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:22:24.925213 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:22:24.931082 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:22:24.932425 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:22:25.270274 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:22:25.271276 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:22:25.276265 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:22:25.277202 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:22:25.281427 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650c1e919c0 pid: 103147 (default app) Jul 19 12:22:25.282383 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650c1e919c0 pid: 103148 (default app) Jul 19 12:22:25.284033 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:22:25.285243 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-971ca15f-37c2-496e-8ed7-cc22bfaf7247 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002299 Jul 19 12:22:25.285648 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Tue Jul 19 12:22:25 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:23:40.476254 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:40.477476 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Jul 19 12:23:40.477870 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:23:40.489587 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:40.490394 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell1:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:40.491228 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:40.492302 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:41.351308 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-7ed28a31-3790-494c-8f14-2a70cb4dfba8 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:41.384974 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-7ed28a31-3790-494c-8f14-2a70cb4dfba8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901091 Jul 19 12:23:41.385912 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jul 19 12:23:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:23:43.629878 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:43.632707 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-6d95b81f-b6f2-4333-a4da-76f9009b340d None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003307 Jul 19 12:23:43.635383 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:23:44.107553 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-85e50e2b-8428-433a-9c46-38b2b2bbae0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:44.126443 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:23:44.126443 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 19 12:23:44.155562 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-85e50e2b-8428-433a-9c46-38b2b2bbae0a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.515336 Jul 19 12:23:44.163261 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:23:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 12:23:44.169895 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:44.171043 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell0:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:44.171751 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell1:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:44.172739 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:44.380289 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-04a770ad-5c0f-4700-8aef-553535e06215 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:44.382641 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:23:44.382641 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 19 12:23:44.451761 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-04a770ad-5c0f-4700-8aef-553535e06215 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287203 Jul 19 12:23:44.452630 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jul 19 12:23:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:23:46.760527 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-85e50e2b-8428-433a-9c46-38b2b2bbae0a admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:46.762113 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-85e50e2b-8428-433a-9c46-38b2b2bbae0a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Jul 19 12:23:46.762517 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:23:47.418203 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-7e401f9d-abb0-42dc-b197-6f8218facd1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:47.436436 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:23:47.436436 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 19 12:23:47.456279 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-7e401f9d-abb0-42dc-b197-6f8218facd1c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684612 Jul 19 12:23:47.457166 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:23:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 12:23:47.469428 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-804b14bd-dfd8-46ce-a56d-042667202366 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:47.470945 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:23:47.470945 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 19 12:23:47.503213 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-804b14bd-dfd8-46ce-a56d-042667202366 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037568 Jul 19 12:23:47.503780 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jul 19 12:23:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:23:49.755132 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-7e401f9d-abb0-42dc-b197-6f8218facd1c admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:49.756254 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-7e401f9d-abb0-42dc-b197-6f8218facd1c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jul 19 12:23:49.756664 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:23:50.152352 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e230d005-1afc-4b2f-88ff-868f8671c496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:50.170818 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e230d005-1afc-4b2f-88ff-868f8671c496 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.408294 Jul 19 12:23:50.171442 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:23:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:23:50.183214 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-ce729e77-8954-4b30-8303-403b5e152b5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:50.205028 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-ce729e77-8954-4b30-8303-403b5e152b5e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025446 Jul 19 12:23:50.205564 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jul 19 12:23:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:23:52.507848 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e230d005-1afc-4b2f-88ff-868f8671c496 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:52.508910 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e230d005-1afc-4b2f-88ff-868f8671c496 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 19 12:23:52.509305 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:23:52.974512 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-54a2a7d7-a001-4394-8810-2475de3ab1f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:52.992581 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-54a2a7d7-a001-4394-8810-2475de3ab1f1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476891 Jul 19 12:23:52.993125 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:23:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 12:23:53.005147 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a047318e-a762-4994-9897-f1dc881402ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:53.028159 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a047318e-a762-4994-9897-f1dc881402ef admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026551 Jul 19 12:23:53.028829 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jul 19 12:23:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:23:55.272265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-54a2a7d7-a001-4394-8810-2475de3ab1f1 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:55.273277 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-54a2a7d7-a001-4394-8810-2475de3ab1f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 19 12:23:55.273680 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:23:55.696370 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-8b12fcbf-fa57-4b90-91dc-6a237c2a329c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "swap": 0}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:55.716984 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-8b12fcbf-fa57-4b90-91dc-6a237c2a329c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437175 Jul 19 12:23:55.721984 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:23:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:23:55.730829 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-ac26a26a-b821-4374-93cb-4920ebe62bf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:23:55.760903 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-ac26a26a-b821-4374-93cb-4920ebe62bf4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033915 Jul 19 12:23:55.761527 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jul 19 12:23:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:23:58.000602 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-8b12fcbf-fa57-4b90-91dc-6a237c2a329c admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:58.001603 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-8b12fcbf-fa57-4b90-91dc-6a237c2a329c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 19 12:23:58.002002 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:23:58.445633 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-26055ee7-b1d0-4fdc-a40a-8d9b6d7f3149 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:23:58.468768 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-26055ee7-b1d0-4fdc-a40a-8d9b6d7f3149 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460595 Jul 19 12:23:58.469309 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jul 19 12:23:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:24:00.742836 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-8b12fcbf-fa57-4b90-91dc-6a237c2a329c admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:00.743850 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-8b12fcbf-fa57-4b90-91dc-6a237c2a329c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 19 12:24:00.744306 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:24:01.160893 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-1b05f7e5-e8e2-436c-9be7-fb8d3cd43db3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "1", "name": "m1.tiny", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:01.181231 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-1b05f7e5-e8e2-436c-9be7-fb8d3cd43db3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.430963 Jul 19 12:24:01.181933 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:24:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:24:01.196228 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d8480eb9-7171-4be0-93c1-8882d8b978e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:01.222543 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d8480eb9-7171-4be0-93c1-8882d8b978e0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030763 Jul 19 12:24:01.223106 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jul 19 12:24:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:24:03.809244 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-1b05f7e5-e8e2-436c-9be7-fb8d3cd43db3 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:03.810250 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-1b05f7e5-e8e2-436c-9be7-fb8d3cd43db3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 19 12:24:03.810675 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:04.201896 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1d1d384e-0643-4669-91d5-f1e1d6e13937 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:04.218611 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-1d1d384e-0643-4669-91d5-f1e1d6e13937 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402084 Jul 19 12:24:04.219085 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:24:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:24:04.231514 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-884efe89-b43d-4105-b809-5be2b13b761a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:04.253725 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-884efe89-b43d-4105-b809-5be2b13b761a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026357 Jul 19 12:24:04.254277 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jul 19 12:24:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:24:06.481934 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1d1d384e-0643-4669-91d5-f1e1d6e13937 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:06.482981 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-1d1d384e-0643-4669-91d5-f1e1d6e13937 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 19 12:24:06.483502 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:06.870562 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-22c02e2c-d22f-4fc1-9b2d-b512da37deb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:06.889825 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-22c02e2c-d22f-4fc1-9b2d-b512da37deb9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.399938 Jul 19 12:24:06.890381 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:24:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:24:06.902931 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-93cdd1b9-0117-4471-b5f8-8faabac4f593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:06.928162 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-93cdd1b9-0117-4471-b5f8-8faabac4f593 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029431 Jul 19 12:24:06.929125 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jul 19 12:24:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:24:09.225531 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-22c02e2c-d22f-4fc1-9b2d-b512da37deb9 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:09.226720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-22c02e2c-d22f-4fc1-9b2d-b512da37deb9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Jul 19 12:24:09.227636 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:24:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:09.698415 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-4019c756-2451-4337-8822-45e2a4628471 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:09.717942 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-4019c756-2451-4337-8822-45e2a4628471 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484743 Jul 19 12:24:09.718595 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:24:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:24:09.731256 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-76f239da-787f-4f87-9e29-7679c61a8a92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:09.756732 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-76f239da-787f-4f87-9e29-7679c61a8a92 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029817 Jul 19 12:24:09.772213 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jul 19 12:24:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:24:12.014236 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-4019c756-2451-4337-8822-45e2a4628471 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:12.015251 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-4019c756-2451-4337-8822-45e2a4628471 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 19 12:24:12.015820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:12.498094 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-813f115b-7a39-4805-9578-b9a9b0f855bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:12.520187 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-813f115b-7a39-4805-9578-b9a9b0f855bf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.494863 Jul 19 12:24:12.521173 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jul 19 12:24:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:24:12.532913 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-32ed8d75-59ea-430a-a253-1a58e8c4c946 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:12.536539 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:12.563139 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-32ed8d75-59ea-430a-a253-1a58e8c4c946 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033928 Jul 19 12:24:12.563714 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jul 19 12:24:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:24:32.668878 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-813f115b-7a39-4805-9578-b9a9b0f855bf admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:32.669882 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-813f115b-7a39-4805-9578-b9a9b0f855bf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 19 12:24:32.670276 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:32.680687 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:33.062691 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-6b01d84d-6be0-43a8-b0c7-e1d51c5a8fde admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:33.079885 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-6b01d84d-6be0-43a8-b0c7-e1d51c5a8fde admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403609 Jul 19 12:24:33.080374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jul 19 12:24:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:24:34.135874 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-813f115b-7a39-4805-9578-b9a9b0f855bf admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:34.137407 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-813f115b-7a39-4805-9578-b9a9b0f855bf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001957 Jul 19 12:24:34.137803 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:34.653326 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d919d08b-b500-45a9-a3d8-ff4ed57b37ae admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:34.658881 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-d919d08b-b500-45a9-a3d8-ff4ed57b37ae admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d919d08b-b500-45a9-a3d8-ff4ed57b37ae admin admin] Request method failure captured: Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Accept: application/json Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Host: 10.222.0.13 Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABi1qKCQPYsAmNkNTmgjVXgDLUE-tMP5sWQwu27bMUhiGzvN5YoasBSe93062_HJB0W2_zaJgKlh0I6KVDk7TMU5_vbk2JEKqmeAQAx3a9uA-xYJf7jea7fHH6nJnU-2fjCtzXSo_LcMWmnjte1dxq8F70d6Mq2vWUAWpHH0pxQG1wcLj8 Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Role: admin,reader,member Jul 19 12:24:34.662464 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Roles: admin,reader,member Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45290f5162bc4ec4b133291838122f88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45290f5162bc4ec4b133291838122f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User: admin Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Id: f3447cd66131465b871daa6541b4276c Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: method: > Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: exception: Flavor 42 could not be found. Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: action_args: {'id': '42'} Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:24:34.664121 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:34.665063 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.666264 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d919d08b-b500-45a9-a3d8-ff4ed57b37ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:24:34.667289 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d919d08b-b500-45a9-a3d8-ff4ed57b37ae admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388500 Jul 19 12:24:34.667289 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jul 19 12:24:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:34.674083 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-f052909a-e29a-4d16-a3a7-15fa51bde871 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:34.677026 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:34.695957 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-f052909a-e29a-4d16-a3a7-15fa51bde871 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025394 Jul 19 12:24:34.696519 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jul 19 12:24:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 12:24:34.706188 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e4463ee9-3845-468d-9e41-27a46edf0472 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:34.727749 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e4463ee9-3845-468d-9e41-27a46edf0472 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025170 Jul 19 12:24:34.728299 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jul 19 12:24:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:24:34.738781 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-cff5ebe6-37b8-407d-87b5-eff0998705e2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:34.744964 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-cff5ebe6-37b8-407d-87b5-eff0998705e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-cff5ebe6-37b8-407d-87b5-eff0998705e2 admin admin] Request method failure captured: Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Accept: application/json Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Connection: keep-alive Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Content-Length: 0 Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Host: 10.222.0.13 Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABi1qKCQPYsAmNkNTmgjVXgDLUE-tMP5sWQwu27bMUhiGzvN5YoasBSe93062_HJB0W2_zaJgKlh0I6KVDk7TMU5_vbk2JEKqmeAQAx3a9uA-xYJf7jea7fHH6nJnU-2fjCtzXSo_LcMWmnjte1dxq8F70d6Mq2vWUAWpHH0pxQG1wcLj8 Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Role: admin,reader,member Jul 19 12:24:34.748265 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Roles: admin,reader,member Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45290f5162bc4ec4b133291838122f88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45290f5162bc4ec4b133291838122f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant: admin Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User: admin Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Id: f3447cd66131465b871daa6541b4276c Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Name: admin Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: method: > Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: exception: Flavor 42 could not be found. Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: action_args: {'id': '42'} Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:24:34.749763 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:34.750619 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:34.751627 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-cff5ebe6-37b8-407d-87b5-eff0998705e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:24:34.752845 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-cff5ebe6-37b8-407d-87b5-eff0998705e2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015202 Jul 19 12:24:34.752845 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jul 19 12:24:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:35.709926 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e4463ee9-3845-468d-9e41-27a46edf0472 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:35.710945 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e4463ee9-3845-468d-9e41-27a46edf0472 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 19 12:24:35.711345 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:36.230865 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-83e457dc-a3c6-4c2c-b340-9fe276ae3c39 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:36.236102 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-83e457dc-a3c6-4c2c-b340-9fe276ae3c39 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-83e457dc-a3c6-4c2c-b340-9fe276ae3c39 admin admin] Request method failure captured: Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Accept: application/json Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Connection: keep-alive Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Content-Length: 0 Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Host: 10.222.0.13 Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABi1qKDToc-ZVPky9nvQsJMR1p9XKvr2JTSIbDMhZrpipHe73z3692WmGUFbIJAHfU3-iPuaemHxx7YkkIzdGdtEytzZNmqKFPj1qzHZk-XDZ7VCHw40Qn3E8kGl5AOcmSsDJn4fsyN8t0BnGMajhv_o3lqtKOp7Xq4G5OvW3RF9A3J9Q4 Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Role: admin,reader,member Jul 19 12:24:36.237720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Roles: admin,reader,member Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45290f5162bc4ec4b133291838122f88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45290f5162bc4ec4b133291838122f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant: admin Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User: admin Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Id: f3447cd66131465b871daa6541b4276c Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Name: admin Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: method: > Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: exception: Flavor 84 could not be found. Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: action_args: {'id': '84'} Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:24:36.239248 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:36.240411 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-83e457dc-a3c6-4c2c-b340-9fe276ae3c39 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:24:36.242482 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-83e457dc-a3c6-4c2c-b340-9fe276ae3c39 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391469 Jul 19 12:24:36.242482 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jul 19 12:24:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 12:24:36.249237 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a0ea5f0e-9cd6-4e09-88dd-15a5eae73b1f admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:36.263256 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a0ea5f0e-9cd6-4e09-88dd-15a5eae73b1f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017586 Jul 19 12:24:36.263773 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jul 19 12:24:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:24:36.273309 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-be776ed0-ae73-4fca-8258-d85053ea5abf admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:36.286765 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-be776ed0-ae73-4fca-8258-d85053ea5abf admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017418 Jul 19 12:24:36.287273 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jul 19 12:24:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:24:36.296330 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e4bc9687-9f03-4ed8-911e-557289fe74d2 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:36.301767 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-e4bc9687-9f03-4ed8-911e-557289fe74d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e4bc9687-9f03-4ed8-911e-557289fe74d2 admin admin] Request method failure captured: Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Accept: application/json Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Host: 10.222.0.13 Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABi1qKDToc-ZVPky9nvQsJMR1p9XKvr2JTSIbDMhZrpipHe73z3692WmGUFbIJAHfU3-iPuaemHxx7YkkIzdGdtEytzZNmqKFPj1qzHZk-XDZ7VCHw40Qn3E8kGl5AOcmSsDJn4fsyN8t0BnGMajhv_o3lqtKOp7Xq4G5OvW3RF9A3J9Q4 Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Role: admin,reader,member Jul 19 12:24:36.303387 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Roles: admin,reader,member Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45290f5162bc4ec4b133291838122f88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45290f5162bc4ec4b133291838122f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User: admin Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Id: f3447cd66131465b871daa6541b4276c Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: method: > Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: exception: Flavor 84 could not be found. Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: action_args: {'id': '84'} Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:24:36.304849 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:36.305610 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:36.306723 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e4bc9687-9f03-4ed8-911e-557289fe74d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:24:36.307753 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e4bc9687-9f03-4ed8-911e-557289fe74d2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012030 Jul 19 12:24:36.307753 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jul 19 12:24:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:37.263808 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-be776ed0-ae73-4fca-8258-d85053ea5abf admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:37.264843 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-be776ed0-ae73-4fca-8258-d85053ea5abf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 19 12:24:37.265246 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:24:37.798095 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-28ea5fdb-f9b0-4183-a468-599e4dc774ef admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:37.803816 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-28ea5fdb-f9b0-4183-a468-599e4dc774ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-28ea5fdb-f9b0-4183-a468-599e4dc774ef admin admin] Request method failure captured: Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Accept: application/json Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Host: 10.222.0.13 Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABi1qKFfUkui6wTyI9ayKGm-PqqmorxyyijhWaNjACkM4HoZaSTzbhWjTDhF2LyQ0iQ_U3F539uXJ4N9BspByA2ey4L7GT47DeAXtgnNrStJLFXybVOj6R3GAkUYQ0KczL-J5-MKL1Cnn9YUq9SdyXVaXqyf6psP11_peaCBC9v4GltQWw Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Role: admin,reader,member Jul 19 12:24:37.805374 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Roles: admin,reader,member Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45290f5162bc4ec4b133291838122f88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45290f5162bc4ec4b133291838122f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User: admin Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Id: f3447cd66131465b871daa6541b4276c Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: method: > Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: exception: Flavor 451 could not be found. Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: action_args: {'id': '451'} Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:24:37.806914 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:37.807820 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.810198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-28ea5fdb-f9b0-4183-a468-599e4dc774ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:24:37.811461 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-28ea5fdb-f9b0-4183-a468-599e4dc774ef admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399217 Jul 19 12:24:37.811461 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jul 19 12:24:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:37.817002 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-a6b80966-8d4d-4ffa-a47f-14612d829ece admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:37.830156 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-a6b80966-8d4d-4ffa-a47f-14612d829ece admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016724 Jul 19 12:24:37.830667 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jul 19 12:24:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:24:37.839750 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:37.854421 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018132 Jul 19 12:24:37.854948 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jul 19 12:24:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:24:37.864792 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-b84c72b5-7596-43d5-8fa9-3440cc1aa32e admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:37.869922 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-b84c72b5-7596-43d5-8fa9-3440cc1aa32e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-b84c72b5-7596-43d5-8fa9-3440cc1aa32e admin admin] Request method failure captured: Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Accept: application/json Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Connection: keep-alive Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Content-Length: 0 Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Host: 10.222.0.13 Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABi1qKFfUkui6wTyI9ayKGm-PqqmorxyyijhWaNjACkM4HoZaSTzbhWjTDhF2LyQ0iQ_U3F539uXJ4N9BspByA2ey4L7GT47DeAXtgnNrStJLFXybVOj6R3GAkUYQ0KczL-J5-MKL1Cnn9YUq9SdyXVaXqyf6psP11_peaCBC9v4GltQWw Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Role: admin,reader,member Jul 19 12:24:37.872017 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Roles: admin,reader,member Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45290f5162bc4ec4b133291838122f88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45290f5162bc4ec4b133291838122f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45290f5162bc4ec4b133291838122f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant: admin Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant-Id: 45290f5162bc4ec4b133291838122f88 Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User: admin Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Id: f3447cd66131465b871daa6541b4276c Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: X-User-Name: admin Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: method: > Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: exception: Flavor 451 could not be found. Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: action_args: {'id': '451'} Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:24:37.873660 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:37.874524 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 19 12:24:37.876109 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-b84c72b5-7596-43d5-8fa9-3440cc1aa32e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:24:37.877493 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-b84c72b5-7596-43d5-8fa9-3440cc1aa32e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012291 Jul 19 12:24:37.877493 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jul 19 12:24:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:38.837853 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:38.838891 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 19 12:24:38.839283 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:39.357562 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-218b92dd-3906-4207-af41-cf402954f805 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:39.375022 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-218b92dd-3906-4207-af41-cf402954f805 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.399762 Jul 19 12:24:39.375582 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jul 19 12:24:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:24:40.337364 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:40.338372 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 19 12:24:40.338765 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:40.862924 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-35c20a5c-7387-44df-8e11-25ca9098c6c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:40.880115 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-35c20a5c-7387-44df-8e11-25ca9098c6c3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402462 Jul 19 12:24:40.880688 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jul 19 12:24:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 12:24:41.847838 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:41.848870 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 19 12:24:41.849512 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:42.394008 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-1ab4b0f1-64e1-4dab-be1f-33167a3d0309 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:42.412417 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-1ab4b0f1-64e1-4dab-be1f-33167a3d0309 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.425270 Jul 19 12:24:42.412945 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jul 19 12:24:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:24:43.379517 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:43.380556 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 19 12:24:43.380985 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:43.904658 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-cee0d41b-fbf3-43d4-99cc-a1b458947763 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:24:43.922934 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-cee0d41b-fbf3-43d4-99cc-a1b458947763 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.405670 Jul 19 12:24:43.923470 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jul 19 12:24:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 12:24:44.893749 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:44.894750 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 19 12:24:44.895137 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:24:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:24:45.430079 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-3440f592-b19d-4cb3-8574-e663616a19fd admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:24:45.449305 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-3440f592-b19d-4cb3-8574-e663616a19fd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.417411 Jul 19 12:24:45.449761 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Tue Jul 19 12:24:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:25:37.007769 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:25:37.008834 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-73a0e5da-7857-4107-b8c2-2b86b4cc6254 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 19 12:25:37.009229 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jul 19 12:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:25:37.019968 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:37.401389 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-2762db32-6314-4b51-a397-16097c053874 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:25:37.421188 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-2762db32-6314-4b51-a397-16097c053874 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405656 Jul 19 12:25:37.421675 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jul 19 12:25:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 12:25:37.444704 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-b83743f3-5a29-4ee6-ae84-b3ed6d87331e admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:25:37.448198 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=14 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:37.454273 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-b83743f3-5a29-4ee6-ae84-b3ed6d87331e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013071 Jul 19 12:25:37.454790 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1282 bytes} [Tue Jul 19 12:25:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:25:37.466002 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-8f144b4a-d909-4d48-8395-2a0c3d8e0643 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:25:37.473510 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-8f144b4a-d909-4d48-8395-2a0c3d8e0643 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011050 Jul 19 12:25:37.474009 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1285 bytes} [Tue Jul 19 12:25:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:25:37.484885 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:25:37.492553 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010743 Jul 19 12:25:37.493103 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1285 bytes} [Tue Jul 19 12:25:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:25:37.504134 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-22187e4d-aca3-42d6-8721-2c545539c61b admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:25:37.511266 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-22187e4d-aca3-42d6-8721-2c545539c61b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010428 Jul 19 12:25:37.511784 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1282 bytes} [Tue Jul 19 12:25:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:29:02.129889 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:02.130928 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 19 12:29:02.131321 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:29:02.272583 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=6 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:02.439231 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-1b24033f-6bc3-49b9-9192-c01dc0110848 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:02.440424 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:29:02.440424 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 19 12:29:02.441643 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-1b24033f-6bc3-49b9-9192-c01dc0110848 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:02.442123 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-1b24033f-6bc3-49b9-9192-c01dc0110848 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:02.442905 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-1b24033f-6bc3-49b9-9192-c01dc0110848 admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:02.443330 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-1b24033f-6bc3-49b9-9192-c01dc0110848 admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:02.476458 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-1b24033f-6bc3-49b9-9192-c01dc0110848 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205416 Jul 19 12:29:02.476997 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jul 19 12:29:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 12:29:03.297904 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:03.298961 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 19 12:29:03.299379 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:29:03.504591 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-9919e2f2-a89e-49b5-9300-1dead7606fc7 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:03.505768 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:29:03.505768 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 19 12:29:03.506961 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-9919e2f2-a89e-49b5-9300-1dead7606fc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:03.507399 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-9919e2f2-a89e-49b5-9300-1dead7606fc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:03.508218 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-9919e2f2-a89e-49b5-9300-1dead7606fc7 admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:03.508914 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-9919e2f2-a89e-49b5-9300-1dead7606fc7 admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:03.527778 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-9919e2f2-a89e-49b5-9300-1dead7606fc7 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085266 Jul 19 12:29:03.528366 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jul 19 12:29:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:29:14.770095 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:14.771099 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 19 12:29:14.771494 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:29:14.916502 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell0:SELECT=4 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:14.917159 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell1:SELECT=4 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:14.917924 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=8 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:14.964746 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-7a5804d5-4b85-4870-a0f2-3018d0c93a4f admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:14.965902 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:29:14.965902 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 19 12:29:14.967113 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a5804d5-4b85-4870-a0f2-3018d0c93a4f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:14.967558 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a5804d5-4b85-4870-a0f2-3018d0c93a4f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:14.968386 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a5804d5-4b85-4870-a0f2-3018d0c93a4f admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:14.968824 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a5804d5-4b85-4870-a0f2-3018d0c93a4f admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:14.994176 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-7a5804d5-4b85-4870-a0f2-3018d0c93a4f admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082165 Jul 19 12:29:14.994720 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jul 19 12:29:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:29:15.811347 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:15.812458 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-23028cf1-a141-4fee-b6d1-701e195fd7c7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 19 12:29:15.812856 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jul 19 12:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:29:16.004661 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-d3ddb1dd-b578-4e53-991e-3768c6f2feaa admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:29:16.005839 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:29:16.005839 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 19 12:29:16.007001 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-d3ddb1dd-b578-4e53-991e-3768c6f2feaa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:16.007439 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-d3ddb1dd-b578-4e53-991e-3768c6f2feaa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:16.008244 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-d3ddb1dd-b578-4e53-991e-3768c6f2feaa admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:29:16.008673 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-d3ddb1dd-b578-4e53-991e-3768c6f2feaa admin admin] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:29:16.029910 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-d3ddb1dd-b578-4e53-991e-3768c6f2feaa admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076300 Jul 19 12:29:16.030380 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jul 19 12:29:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:30:12.200083 dv-cinder-820994-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 12:30:12.200695 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: Tue Jul 19 12:30:12 2022 - graceful shutdown triggered... Jul 19 12:30:12.201140 dv-cinder-820994-4-iscsi devstack@n-api.service[103147]: Gracefully killing worker 1 (pid: 103147)... Jul 19 12:30:12.201505 dv-cinder-820994-4-iscsi devstack@n-api.service[103148]: Gracefully killing worker 2 (pid: 103148)... Jul 19 12:30:13.201834 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: worker 1 buried after 1 seconds Jul 19 12:30:13.202371 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: worker 2 buried after 1 seconds Jul 19 12:30:13.202371 dv-cinder-820994-4-iscsi devstack@n-api.service[103146]: goodbye to uWSGI. Jul 19 12:30:13.203427 dv-cinder-820994-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 19 12:30:13.204007 dv-cinder-820994-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 12:30:13.206826 dv-cinder-820994-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 12:30:13.216430 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 12:30:13 2022] *** Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: nodename: dv-cinder-820994-4-iscsi Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: machine: x86_64 Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: clock source: unix Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: pcre jit disabled Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: detected number of CPU cores: 4 Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: current working directory: / Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: detected binary path: /usr/bin/uwsgi-core Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: your processes number limit is 47680 Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: your memory page size is 4096 bytes Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: detected max file descriptor number: 2048 Jul 19 12:30:13.218182 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: lock engine: pthread robust mutexes Jul 19 12:30:13.219081 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: thunder lock: enabled Jul 19 12:30:13.219081 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 12:30:13.219081 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 12:30:13.264488 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: Python main interpreter initialized at 0x56419c5c89c0 Jul 19 12:30:13.264488 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: python threads support enabled Jul 19 12:30:13.264488 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: your server socket listen backlog is limited to 100 connections Jul 19 12:30:13.264488 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: your mercy for graceful operations on workers is 90 seconds Jul 19 12:30:13.264955 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 12:30:13.264955 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: *** Operational MODE: preforking *** Jul 19 12:30:13.265206 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: *** uWSGI is running in multiple interpreter mode *** Jul 19 12:30:13.265206 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: spawned uWSGI master process (pid: 118117) Jul 19 12:30:13.265411 dv-cinder-820994-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 12:30:13.265950 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: spawned uWSGI worker 1 (pid: 118119, cores: 1) Jul 19 12:30:13.266499 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: spawned uWSGI worker 2 (pid: 118120, cores: 1) Jul 19 12:30:13.266825 dv-cinder-820994-4-iscsi devstack@n-api.service[118117]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 12:30:13.917361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 12:30:13.924104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 12:30:15.089223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:30:15.089223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: from cryptography.utils import int_from_bytes Jul 19 12:30:15.089826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:30:15.089826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: from cryptography.utils import int_from_bytes Jul 19 12:30:15.110132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:30:15.110132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: from cryptography.utils import int_from_bytes Jul 19 12:30:15.110721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:30:15.110721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: from cryptography.utils import int_from_bytes Jul 19 12:30:17.446134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 12:30:17.446688 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 12:30:17.446904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 12:30:17.447265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 12:30:17.447523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 12:30:17.447911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.448262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.448587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.448908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.449241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.449551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.449873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.450195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.450526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.450789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.451106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.451436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-4-iscsi {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.451759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.452067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.452441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.452714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.453020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.453341 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.453649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.454142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.455496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.455496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.455496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.455827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.456134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.456514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.456844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.457161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.457917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.457917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.458182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-4-iscsi {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.458499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.458809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.459125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.459608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.459845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.460154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.460506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.460831 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.461174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.461487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.461825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.462111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.462435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.462765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.463053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.463363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.463685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.463995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.464326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.464581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.464895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.465219 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.465540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.466124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.466377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.466696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.467018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.467327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.467635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.467942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.468273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.468584 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.468892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.469201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.469510 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.469829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.470148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.470473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.470784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.471105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.471504 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.471758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.472066 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.472484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.472807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.473120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.473440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.473761 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.474071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.474380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.474689 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.475009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.475345 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.475651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.475910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.476233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.476408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 12:30:17.476838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.476988 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 12:30:17.477137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.477291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 12:30:17.477480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.477480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.477779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 12:30:17.477779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 12:30:17.478064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.478064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.478351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.478491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.478636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.478782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.478928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.479074 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.479230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.479380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.479528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.479680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.479831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.479978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.480126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.480310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.480463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.480738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.480926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.481090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.481243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.481391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.481538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.481680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.481859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-4-iscsi {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.482031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.482180 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.482328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.482503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.482735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.482735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.483068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.483220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.483361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.483512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.483652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.483798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.483955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.484103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.484303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.484455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.484455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.484730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.484886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.485027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.485180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.485328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.485467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.485614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.485764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.485912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.486152 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.486309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.486449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.486588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.486728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.486875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.487027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.487174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.487321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.487461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.487623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.488341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.488492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.488492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.488766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-4-iscsi {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.488904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.489057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.489197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.489335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.489485 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.489653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.489806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.489958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.490122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.490122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.490432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.490572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.490725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.490872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.491012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.491182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.491336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.491477 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.491625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.491795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.491952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.492110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.492297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.492439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.492592 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.492758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.492915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.493056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.493197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.493349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.493500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.493639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.493777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.493952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.494141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.494303 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.494458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.494604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.494749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.494899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.495061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.495287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.495449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.495623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.495770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.495920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.496121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.496374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.496536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.496678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.496830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.496971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.497125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.497265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.497407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.497554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.497694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.497844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.497998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.498144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.498290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.498452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.498867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.499016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.499156 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.499295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.499447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.499601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.499741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.499943 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.500120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.500306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.500456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.500627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.500780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.500954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.501130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.501275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.501425 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.501572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.501712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.501865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.502013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.502170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.502324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.502472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.502693 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.502828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.503081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.503441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.504080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.504445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.504582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.504788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.504889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.505215 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.505309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.505531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.505699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.505892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.506173 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.506265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.506493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.506584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.506813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.506907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.507127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.507225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.507447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.507638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.507923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.508295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.508608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.508761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.508903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.509060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.509203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.509447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.509591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.509774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.509983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.510145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.510389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.510698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.510841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.510987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.511125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.511302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.511443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.511617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.511757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.511928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.512077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.512257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.512426 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.512576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.512756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.512897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.513095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.513244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.513459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.513598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.513772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.513912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.514097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.514253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.514424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.514575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.514738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.514878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.515049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.515197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.515344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.515490 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.515657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.515805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.515984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.516124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.516393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.516545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.516696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.516841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.517021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.517161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.517328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.517463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.517631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.517781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.517955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.518097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.518269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.518412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.518573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.518711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.518892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.519055 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.519333 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.519488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.519634 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.519771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.519910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.520132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.520290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.520471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.520782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.520932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.521078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.521222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.521392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.521547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.521695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.521833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.521997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.522138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.522307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.522457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.522597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.522765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.522917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.523088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.523236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.523527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.523675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.523859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.524011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.524268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.524426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.524543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.524865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.525181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.525418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:30:17.525667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.525790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.525987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.526096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.526326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.526482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.526650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.526758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.526969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.527123 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.527288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.527464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.527603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.527868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.528121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.528235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.528468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.528551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.528950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.529064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.529157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.529246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.529468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.529561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.529789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.529998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.530114 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.530341 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.530435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.530783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.530972 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.531074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.531306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.531397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.531631 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.531730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.531958 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.532049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.532340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.532434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.532676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.532768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.532999 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.533085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.533312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.533442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.533673 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.534011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.534120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.534335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.534443 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.534667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.534771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.534982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.535074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.535309 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.535402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.535657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.535760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.535979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.536077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.536333 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.536439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.536667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.536767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.536988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.537079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.537315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.537414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.537638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.537742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.537958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.538050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.538279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.538561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.538652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.538893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.538992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.539213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.539311 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.539540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.539638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.539860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.539950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.540222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.540402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.540563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.540892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.541009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.541211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.541317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.541528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.541650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.541846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.541948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.542159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.542260 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.542472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.542589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.542784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.542912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.543098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.543236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.543407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.543561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.543732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.543878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.544063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.544225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.544401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.544551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.544738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.544874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.545052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.545191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.545368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.545508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.545684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.545830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.546000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.546155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.546316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.546478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.546633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.546798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.546949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.547114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.547261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.547437 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.547587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.547759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.547904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.548075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.548231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.548418 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.548558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.548741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.548871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.549079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.549185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.549402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.549494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.549731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.549824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.550085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.550717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.550922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.551137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.551247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.551456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.551549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.551789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.551891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.552110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.552234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.552450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.552561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.552765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.552858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.553084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.553262 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.553433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.553593 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.553752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.553896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.554845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.555015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.555163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.555345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.555487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.555638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.555784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.555924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.556061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.556061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.556061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.556583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.556724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.556876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.557083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.557235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.557384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.557523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.557670 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.557817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.557965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.558105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.558280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.558435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.558618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.558772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.558933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.559081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.559275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.559423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.559604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.559760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.559919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.560059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.560320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.560597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.560744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.560989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.561301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.561445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.561607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.561753 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.561986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.562143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.562293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.562442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.562589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.562737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.562902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.563070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.563213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.563369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.563533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.563687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.563835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.563988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.564165 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.564369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.564570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.564730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.564872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.565011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.565191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.565339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.565571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.565730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.565923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.566575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.566777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.566923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.567098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.567255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.567427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.567574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.567740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.567887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.568064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.568269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.568419 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.568566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.568707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.568855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.569030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.569185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.569356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.569511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.569672 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.569834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.569997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.570155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.570302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.570532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.570710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.570870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.571100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.571408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.571558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.571706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.571866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.572096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.572319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.572478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.572645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.572786 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.572942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.573083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.573222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.573372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.573522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.573662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.573810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.573951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.574091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.574229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.574368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.574517 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.574667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.574814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.574954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.575189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.575341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.575490 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.575638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.575778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.575918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.576060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.576227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.576387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.576550 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.576698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.576845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.576994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.577142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.577296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.577436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.577583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.577722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.577869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.578018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.578172 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.578332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.578481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.578658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.578807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.578963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.579330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.579488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.579636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.579782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.579922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.580071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.580249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.580397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.580567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.580781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.580938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.581515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.581679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.581830 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.581980 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.582200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.582357 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.582574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.582725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.582875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.583015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.583174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.583337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.583485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.583625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.583765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.583904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.584058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.584251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.584407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.584557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.584705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.584853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.584994 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.585152 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.585301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.585441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.585581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.585728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.585869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.586021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.586162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.586301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.586448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.586589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.586737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.586890 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.587041 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.587189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.587330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.587475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.587626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.587774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.587922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.588069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.588227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.588374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.588526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.588667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.588667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.588953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.589095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.589242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.589395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.589536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.589676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.589824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.589971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.590125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.590266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.590407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.590546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.590695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.590932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.591091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.591091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.591599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.591599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.591887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.592036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.592303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.592467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.592617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.592758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.592904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.593056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.593211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.593364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.593506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.593655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.593803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.593953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.594094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.594242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.594390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.594537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.594685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.594832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.594990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.595131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.595270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.595422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.595571 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.595711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.595858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.596006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.596146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.596327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.596470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.596655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.596822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.596964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.597634 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.597784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.597925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.598112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.598261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.598401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.598554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.598740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.598894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.599125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.599277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.599429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.599583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.599725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.599865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.600011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.600201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.600365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.600516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.600657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.600832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.601070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.601254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.601411 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.601782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.601939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.602088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.602229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.602451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.602608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.602758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.602899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.603039 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.603179 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.603327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.603495 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.615938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.616827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.616988 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.617147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.617311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.617463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.617613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.617755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.617896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.618051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.618195 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.618335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.618475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.618635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.618776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.618931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.619081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.619229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.619379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.619528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.619668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.619821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.619963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.620104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.620268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.620268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.620563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.620714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.620862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.621009 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.621158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.621300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.621454 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.621603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.621752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.621900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.622763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.624298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.624298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.624298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.624298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.624298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.624298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.624298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.625242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.625384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.625384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.625384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.625384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.626242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.626386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.626534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.626682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.626836 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.626978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.627126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.627285 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.627435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.627585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.627735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.627877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.628024 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.628165 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.628331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.628523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.628674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.628823 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.628964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.629126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.629274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.629466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.629466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.629746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.629895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.630036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.630176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.630325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.630474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.630622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.630763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.630903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.631059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.631059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.631343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.631492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.631642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.631783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.631922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.632071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.632071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.632415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.632415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.632682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.632834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.633000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.633000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.633286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.633435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.633576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.633576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.633858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.634026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.634242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.634388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.634543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.634705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.634855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.635012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.635159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.635304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.635457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.635612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.636009 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.636009 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.636412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.636571 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.636733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.636891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.637955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.638240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.638393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.638548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.638704 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.638851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.638998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.639155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.639303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.639461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.639609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.639755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.639910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.640058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.640238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.640394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.640542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.640688 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.640844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.640999 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.641170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.641170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.641466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.641621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.641767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.641923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.642083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.642238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.642393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.642547 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.642694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.642840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.642994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.643161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.643309 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.643454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.643600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.643755 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.643909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.644135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.644454 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.644633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.644800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.644971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.645132 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.645316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.645484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.645644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.645868 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.646314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.646553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.646728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.646881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.647042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.647194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.647346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.647497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.647655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.647819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.647984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.648137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.648314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.648479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.648631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.648790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.648949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.649101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.649251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.649251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.649251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.649251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.649867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.650020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.650170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.650319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.650477 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.650639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.650791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.650947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.651097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.651253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.651253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.651548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.651700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.651879 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.652032 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.652199 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.652359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.652523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.652676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.652826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.652982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.653133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.653298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.653450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.653600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.653770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.653770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.654070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.654232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.654384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.654629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.654796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.654955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.655105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.655264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.655423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.655575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.655732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.655904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.656065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.656548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.656791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.656959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.657120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.657272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.657433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.657600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.657780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.658502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.658667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.658820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.658993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.659146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.659297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.659449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.660089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.660274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.660442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.660608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.660769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.660920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.661080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.661239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.661415 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.661575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.661726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.661876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.662035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.662200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.662359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.662359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.662645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.662802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.662960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.663126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.663277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.663439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.663590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.663748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.663914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.664092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.664311 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.664479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.664650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.664877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665504 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.665996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.666286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.666679 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.666922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.667082 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.667245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.667407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.667567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.667719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.667877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.668040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.668231 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.668400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.668560 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.668712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.668871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.669023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.669181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.669335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.669486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.669486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.669784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.669959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.670120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.670287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.670449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.670602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.670761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.670926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.671078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.671236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.671396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.671555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.671707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.671882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.672040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.672256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.672418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.672418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.672727 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.672894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.673046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.673204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.673355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.673513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.673679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.673848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.674020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.674175 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.674325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.674476 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.674637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.674788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.675040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.675201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.675973 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.676139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.676139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.676139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.676928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.677162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.677320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.677487 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.677640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.677799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.677950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.678109 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.678260 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.678484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.678646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.678807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.678807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.679122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.679122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.679435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.679586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.679744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.679744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.680032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.680237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.680399 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.680561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.680722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.680875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.681036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.681198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.681350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.681594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.681756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.681916 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.682077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.682239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.682239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.682533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.682685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.682851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.683021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.683192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.683345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.683494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.683644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.683802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.683966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.684131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.684308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.684460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.684611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.684762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.684929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.687588 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.687811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.687980 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.688149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.688360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.688534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.688698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.688853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.689005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.689167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.689330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.689492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.689644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.689815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.689967 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.690119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.690283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.690437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.690437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.690732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.690883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.691041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.691200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.691359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.691512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.691670 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.691833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.691983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.692142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.692325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.692478 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.692628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.692778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.692951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.693103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.693254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.693411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.693565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.693726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.693887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.694054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.694211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.694211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.694514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.694514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.694815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.694972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.695146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.695376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.695534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.695707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.695860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.696018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.696170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.696356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.696509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.696675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.696823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.696915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.697076 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.697227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.697379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.697836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.698013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.698166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.698317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.698468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.698627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.698789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.698789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.699084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.699236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.699386 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.699552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.699712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.699874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.700033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.700251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.700412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.700579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.700731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.700890 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.701049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.701049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.701346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.701346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.701346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.701774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.701937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.702095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.702259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.702411 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.702561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.702720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.702872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.703022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.703186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.703186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.703472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.703622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.703771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.703938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.704111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.704292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.704292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.704580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.704730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.704892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.705054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.705215 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.705386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.705618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.705784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.705945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.706116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.706268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.706268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.706561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.706561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.706861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.706861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.707158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.707158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.707461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.707641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.707641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.708269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.708443 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.708596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.708754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.708915 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.709074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.709227 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.709387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.709539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.709689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.709854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.710014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.710167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.710337 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.710489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.710648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.710874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.711037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.711189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.711341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.711499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.711665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.711817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.711969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.712127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.712395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.712395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.712694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.712847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.712997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.713147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.713298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.713451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.713609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.713768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.713919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.714082 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.714242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.714409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.714571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.714732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.714890 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.715042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.715199 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.715359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.715521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.715770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.715939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.716092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.716288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.716462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.716462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.716773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.716925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.717075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.717233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.717393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.717393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.717691 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.717843 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.718293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.718447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.718608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.718781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.718942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.719101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.719260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.719260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.719566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.719719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.719876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.720027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.720205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.720385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.720538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.720696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.720861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.720861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.721148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.721313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.721468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.721628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.721782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.721942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.722610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.722768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.722768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.723071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.723245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.723406 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.723568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.723980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.724577 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.724731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.724893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.725047 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.725212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.725364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.725521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.725680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.725937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.726111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.726277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.726431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.726821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.726990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.727144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.727310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.727462 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.727612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.727771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.727924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.728415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.728598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.728764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.728917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.729540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.730688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.730688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.730980 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.731193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.731193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.731193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.731193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.731193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.731193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.732070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.732070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.732397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.732574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.732737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.732737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.733033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.733192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.733393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.733550 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.733702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.733861 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.734027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.734191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.734352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.734524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.734677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.734837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.734996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.735154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.735306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.735457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.735607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.735773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.735942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.736167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.736386 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.736540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.736714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.736881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.737041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.737193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.737352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.737503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.737667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.738700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.738866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.739018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.739169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.739321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.739499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.739655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.739805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.739964 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.740123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.740317 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.740479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.740658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.740823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.740984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.741143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.741304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.741465 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.741639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.741794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.741953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.742104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.742264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.742264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.742552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.742711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.742864 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.743035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.743271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.743426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.743590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.743751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.743904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.744077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.744293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.744461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.744623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.744774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.744935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.745102 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.745254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.745405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.745564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.745728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.745888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.746049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.746340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.746508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.746669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.746828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.746995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.747149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.747309 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.747470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.747621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.747790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.747964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.748125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.748306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.748460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.749320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.749320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.749320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.749781 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.749943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.750106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.750266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.750419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.750595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.750756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.750909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.751061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.752229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.753417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.754619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.755753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.755753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.755753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.755753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.755753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:30:17.755753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 12:30:17.900537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO dbcounter [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Registered counter for database nova_api Jul 19 12:30:17.905862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Registered counter for database nova_api Jul 19 12:30:17.920773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_db.sqlalchemy.engines [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:17.926028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:17.928117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writer thread running {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:17.933176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:17.983825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.context [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce8bd2-84ca-4c65-9066-7f515d1d3ee5(cell1) {{(pid=118119) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 12:30:17.988496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:30:17.990067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:30:17.990429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.context [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce8bd2-84ca-4c65-9066-7f515d1d3ee5(cell1) {{(pid=118120) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 12:30:17.990882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:30:17.992909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:30:17.994529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:30:17.994925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO dbcounter [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Registered counter for database nova_cell0 Jul 19 12:30:17.996109 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:30:17.996971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:30:17.999233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:30:17.999352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO dbcounter [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Registered counter for database nova_cell1 Jul 19 12:30:18.001284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Registered counter for database nova_cell0 Jul 19 12:30:18.005342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Registered counter for database nova_cell1 Jul 19 12:30:18.006490 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_db.sqlalchemy.engines [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:18.009419 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_db.sqlalchemy.engines [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:18.011932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:18.013245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writer thread running {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:18.014033 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:18.018594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:18.151927 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writer thread running {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:18.156805 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:18.161255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO dbcounter [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Registered counter for database nova_cell0 Jul 19 12:30:18.167514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Registered counter for database nova_cell0 Jul 19 12:30:18.168593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_db.sqlalchemy.engines [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:18.172888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writer thread running {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:18.174126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:30:18.178519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:30:18.484555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: WARNING keystonemiddleware.auth_token [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:30:18.491844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: WARNING keystonemiddleware.auth_token [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:30:18.500753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:30:18.508730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:30:18.835047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: WARNING keystonemiddleware.auth_token [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:30:18.840905 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: WARNING keystonemiddleware.auth_token [None req-954e8327-b5e2-4e30-994c-b6d36e0fb928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:30:18.847304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56419c5c89c0 pid: 118119 (default app) Jul 19 12:30:18.852664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 12:30:18.858631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-53332198-12a0-4154-a2d7-815a6d071b37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 12:30:18.865320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56419c5c89c0 pid: 118120 (default app) Jul 19 12:31:00.061797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:00.063896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:00.065877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:00.067021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:01.852102 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8a40493b-0c57-487b-93cd-954038ad5dd6 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Action: 'create', calling method: .version_select at 0x7fd995a0cc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2036079913"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:02.395584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ae3dc25e-c582-464d-9b03-434507cb9a40 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd995ac6790>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:02.469899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:02.471328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:02.476752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:02.478180 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:03.670819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ae3dc25e-c582-464d-9b03-434507cb9a40 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f03f941c-4948-48ad-8772-92759fd7b13d" status: 200 len: 350 microversion: 2.1 time: 1.653296 Jul 19 12:31:03.672435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:02 2022] GET /compute/v2.1/os-volumes/f03f941c-4948-48ad-8772-92759fd7b13d => generated 350 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:31:04.435271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8a40493b-0c57-487b-93cd-954038ad5dd6 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.386148 Jul 19 12:31:04.437038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1154 bytes} [Tue Jul 19 12:31:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 12:31:04.450586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1868d9e7-fd5d-442c-b6b9-c63e711bd1bc tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd995915af0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:05.110578 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1868d9e7-fd5d-442c-b6b9-c63e711bd1bc tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8" status: 200 len: 346 microversion: 2.1 time: 0.665325 Jul 19 12:31:05.111546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:04 2022] GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 => generated 346 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:05.124589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-da0b4dec-b157-4a0b-86a6-56a8a06b43c7 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Action: 'create', calling method: .version_select at 0x7fd9958d69d0>, body: {"snapshot": {"volume_id": "6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-757402531"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:05.675669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-da0b4dec-b157-4a0b-86a6-56a8a06b43c7 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.556160 Jul 19 12:31:05.676565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 2/4] 10.222.0.13 () {60 vars in 1161 bytes} [Tue Jul 19 12:31:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:05.686199 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-17ad697f-68c1-4434-9e28-a8098bf5c3c0 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd995915b80>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:05.819168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-17ad697f-68c1-4434-9e28-a8098bf5c3c0 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 286 microversion: 2.1 time: 0.136620 Jul 19 12:31:05.825187 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 3/5] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:05 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:05.834304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c09a4fcb-ac62-4ea5-b5b4-5e695a536ee0 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958d6ee0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:06.072398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-704b1c5d-6415-48b5-8fee-83a472c05c61 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd9958da3a0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:06.211100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c09a4fcb-ac62-4ea5-b5b4-5e695a536ee0 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.384223 Jul 19 12:31:06.217262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1139 bytes} [Tue Jul 19 12:31:05 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:06.222747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ae4fee1e-ffeb-4600-baa6-bf63913f4800 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958ee790>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:06.278747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-704b1c5d-6415-48b5-8fee-83a472c05c61 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4908b818-6d85-465e-bbad-0792d73e6239" status: 200 len: 351 microversion: 2.1 time: 0.211402 Jul 19 12:31:06.279853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:06 2022] GET /compute/v2.1/os-volumes/4908b818-6d85-465e-bbad-0792d73e6239 => generated 351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:06.312651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ae4fee1e-ffeb-4600-baa6-bf63913f4800 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 286 microversion: 2.1 time: 0.094227 Jul 19 12:31:06.317699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:06 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:07.328222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3220724c-13fd-44ed-9191-1646104efa12 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958da940>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:07.378527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3220724c-13fd-44ed-9191-1646104efa12 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 286 microversion: 2.1 time: 0.056483 Jul 19 12:31:07.379090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:07 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:08.390576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bca2c5fd-710d-4ec0-8a99-b894b17d157a tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958eeee0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:08.444034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bca2c5fd-710d-4ec0-8a99-b894b17d157a tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 286 microversion: 2.1 time: 0.057120 Jul 19 12:31:08.444702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 5/10] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:08 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:09.459099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8cd885d9-87bc-48de-a0e2-c5f554b12333 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958daca0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:09.520897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8cd885d9-87bc-48de-a0e2-c5f554b12333 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 287 microversion: 2.1 time: 0.069015 Jul 19 12:31:09.521461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:09 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:09.531757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-00f8ab90-c7de-4bab-8b46-601cc7fa5348 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958eed30>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:09.716398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-00f8ab90-c7de-4bab-8b46-601cc7fa5348 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 202 len: 0 microversion: 2.1 time: 0.188122 Jul 19 12:31:09.721638 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1253 bytes} [Tue Jul 19 12:31:09 2022] DELETE /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 12:31:09.727199 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-975e4020-955a-4620-94bb-017a750d821f tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958da4c0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:09.793419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-975e4020-955a-4620-94bb-017a750d821f tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 286 microversion: 2.1 time: 0.070534 Jul 19 12:31:09.795341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:09 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:31:10.806520 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-334f8d88-de99-4025-8361-32c977020cbd tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958ee5e0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:10.851503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-334f8d88-de99-4025-8361-32c977020cbd tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 286 microversion: 2.1 time: 0.048883 Jul 19 12:31:10.855960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 7/14] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:10 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:11.298007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1327764071", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:11.508507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] validate_networks() for [('af3e2e9d-40a0-4fc6-a69d-01cb00762ce4', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:31:11.863947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f80ee8f4-fae1-4553-bcc6-203fcbdba6a0 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958d6820>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:11.915613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f80ee8f4-fae1-4553-bcc6-203fcbdba6a0 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 200 len: 286 microversion: 2.1 time: 0.056548 Jul 19 12:31:11.919871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:11 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:31:12.352133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c4bc44b7-9bcc-4ce4-ba84-e4a36c121dc8 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd9958fc0d0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:12.442581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c4bc44b7-9bcc-4ce4-ba84-e4a36c121dc8 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5b7f1447-8458-46db-ac9b-e455e8a8197a" status: 200 len: 351 microversion: 2.1 time: 0.094633 Jul 19 12:31:12.455105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:12 2022] GET /compute/v2.1/os-volumes/5b7f1447-8458-46db-ac9b-e455e8a8197a => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:12.464506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3901a7dd-a73d-49b1-b833-2d169a03d40b tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd9958d6940>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:12.678661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3901a7dd-a73d-49b1-b833-2d169a03d40b tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.220046 Jul 19 12:31:12.689122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 10/17] 10.222.0.13 () {58 vars in 1133 bytes} [Tue Jul 19 12:31:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:12.700335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-49079412-5c06-4c86-8e78-9e3904512be3 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd9958ee670>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:12.912823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-49079412-5c06-4c86-8e78-9e3904512be3 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.221677 Jul 19 12:31:12.922355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 11/18] 10.222.0.13 () {58 vars in 1148 bytes} [Tue Jul 19 12:31:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:12.928589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f2b05ec4-2295-47e8-b86a-c8daecbe5fd9 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd9958fc5e0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:13.155686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f2b05ec4-2295-47e8-b86a-c8daecbe5fd9 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.232162 Jul 19 12:31:13.156669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 12/19] 10.222.0.13 () {58 vars in 1133 bytes} [Tue Jul 19 12:31:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:13.170262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a263aff8-f3f6-4748-873b-d8dde1529960 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958eeca0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:13.229031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-a263aff8-f3f6-4748-873b-d8dde1529960 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] HTTP exception thrown: Snapshot 4de91289-6cc9-4ac7-a22a-2c39884d5bd2 could not be found. Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a263aff8-f3f6-4748-873b-d8dde1529960 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Request method failure captured: Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 HTTP/1.1 Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qQDgTuDnNjZugGerx1sJB1SXCj2PWKt1zz5zbFSlxU6lk8RlaBnGQtbrmQLWPNSMTQGB1DhnZoGbUP4c_2KTqsZWpbTYNGH6-hprSw86Meie5tvo5EzlDPCV094214xR7x4KNUM1AYcIP7jhuYm7TL7QWVhRtsu9F2iRu4HbEQHar4 Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:31:13.234226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_402f66e81fd14db9ac98506798ba4282", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: b1b1566726794259a515728a31a24a85 Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Snapshot 4de91289-6cc9-4ac7-a22a-2c39884d5bd2 could not be found. Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '4de91289-6cc9-4ac7-a22a-2c39884d5bd2'} Jul 19 12:31:13.235594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4de91289-6cc9-4ac7-a22a-2c39884d5bd2 could not be found. (HTTP 404) (Request-ID: req-6e6a54a6-4bc1-4491-9bd2-bf806b24accd) Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:13.236618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:13.238290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4de91289-6cc9-4ac7-a22a-2c39884d5bd2 could not be found. Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 12:31:13.239566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4de91289-6cc9-4ac7-a22a-2c39884d5bd2 could not be found. Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4de91289-6cc9-4ac7-a22a-2c39884d5bd2 could not be found. Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a263aff8-f3f6-4748-873b-d8dde1529960 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Returning 404 to user: Snapshot 4de91289-6cc9-4ac7-a22a-2c39884d5bd2 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:13.241039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a263aff8-f3f6-4748-873b-d8dde1529960 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2" status: 404 len: 111 microversion: 2.1 time: 0.070711 Jul 19 12:31:13.241893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 13/20] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jul 19 12:31:13 2022] GET /compute/v2.1/os-snapshots/4de91289-6cc9-4ac7-a22a-2c39884d5bd2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:13.249847 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-90a733ba-51d4-407b-982e-889515fbd280 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd99626e0d0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:13.530319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-90a733ba-51d4-407b-982e-889515fbd280 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.288782 Jul 19 12:31:13.538758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 14/21] 10.222.0.13 () {58 vars in 1166 bytes} [Tue Jul 19 12:31:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:13.553537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c6116a00-c139-4443-9754-68d379b87a2c tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd9958fc8b0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:13.905428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:31:13.905943 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:31:13.906304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:31:13.907004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:31:13.909064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:31:13.934349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:13.936447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:13.944404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:13.944981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:14.011984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:31:14.029474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for user 62766e7afd01401293df7e08707d6d95 and project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:31:14.043481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:31:14.046279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:31:14.117845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c6116a00-c139-4443-9754-68d379b87a2c tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8" status: 202 len: 0 microversion: 2.1 time: 0.577850 Jul 19 12:31:14.118346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 15/22] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:31:13 2022] DELETE /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 12:31:14.199008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-673e6518-c1f6-4762-b137-83757c530264 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.126801 Jul 19 12:31:14.199666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 8/23] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:31:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 3128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:31:14.211523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2784b171-6bae-450d-9b47-0dc8b1f3648e tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd994ff0550>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:14.437920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2784b171-6bae-450d-9b47-0dc8b1f3648e tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.236696 Jul 19 12:31:14.438804 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 9/24] 10.222.0.13 () {58 vars in 1169 bytes} [Tue Jul 19 12:31:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:14.451840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fdd77fb4-c3a6-4b63-8dcd-0e7df739e758 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd994ffd310>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:14.510036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1101215099", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "networks": [{"uuid": "1ef81d2c-f556-4cbb-9d95-e02430927c04"}]}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:14.761695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] validate_networks() for [('1ef81d2c-f556-4cbb-9d95-e02430927c04', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:31:14.920681 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-fdd77fb4-c3a6-4b63-8dcd-0e7df739e758 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] HTTP exception thrown: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fdd77fb4-c3a6-4b63-8dcd-0e7df739e758 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Request method failure captured: Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 HTTP/1.1 Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQDgTuDnNjZugGerx1sJB1SXCj2PWKt1zz5zbFSlxU6lk8RlaBnGQtbrmQLWPNSMTQGB1DhnZoGbUP4c_2KTqsZWpbTYNGH6-hprSw86Meie5tvo5EzlDPCV094214xR7x4KNUM1AYcIP7jhuYm7TL7QWVhRtsu9F2iRu4HbEQHar4 Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:14.928103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_402f66e81fd14db9ac98506798ba4282", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: b1b1566726794259a515728a31a24a85 Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8'} Jul 19 12:31:14.929399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. (HTTP 404) (Request-ID: req-9bf05967-d665-46ae-818c-fdc1a1ce1165) Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:14.930197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:14.935868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 12:31:14.936939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fdd77fb4-c3a6-4b63-8dcd-0e7df739e758 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Returning 404 to user: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fdd77fb4-c3a6-4b63-8dcd-0e7df739e758 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8" status: 404 len: 109 microversion: 2.1 time: 0.481629 Jul 19 12:31:14.937950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 10/25] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:14 2022] GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 => generated 109 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:14.946766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a654ea3-bb79-4d67-88ce-349fb6d0fbbe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:14.952956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a654ea3-bb79-4d67-88ce-349fb6d0fbbe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:15.155099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a654ea3-bb79-4d67-88ce-349fb6d0fbbe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:15.188956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a654ea3-bb79-4d67-88ce-349fb6d0fbbe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1222 microversion: 2.1 time: 0.249232 Jul 19 12:31:15.190331 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 11/26] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:14 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1222 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:15.197442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4d59a520-e616-4289-8170-0cd683faafb1 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd994764820>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:15.746549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4d59a520-e616-4289-8170-0cd683faafb1 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.554812 Jul 19 12:31:15.747475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 12/27] 10.222.0.13 () {58 vars in 1154 bytes} [Tue Jul 19 12:31:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:15.752688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d101886c-20ac-4237-a2e0-d06d09205a1d tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd99470ec10>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:15.928395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:31:15.929602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:31:15.930566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:31:15.931746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:31:15.932665 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:31:15.965975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:15.967370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:15.970302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:15.970903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:16.000457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-d101886c-20ac-4237-a2e0-d06d09205a1d tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] HTTP exception thrown: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d101886c-20ac-4237-a2e0-d06d09205a1d tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Request method failure captured: Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 HTTP/1.1 Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQDgTuDnNjZugGerx1sJB1SXCj2PWKt1zz5zbFSlxU6lk8RlaBnGQtbrmQLWPNSMTQGB1DhnZoGbUP4c_2KTqsZWpbTYNGH6-hprSw86Meie5tvo5EzlDPCV094214xR7x4KNUM1AYcIP7jhuYm7TL7QWVhRtsu9F2iRu4HbEQHar4 Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:16.002928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_402f66e81fd14db9ac98506798ba4282", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: b1b1566726794259a515728a31a24a85 Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8'} Jul 19 12:31:16.004310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. (HTTP 404) (Request-ID: req-43534cb4-4c31-402e-9653-dc8240ffb2a1) Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:16.005202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 12:31:16.006441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 12:31:16.008562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.009718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.013231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d101886c-20ac-4237-a2e0-d06d09205a1d tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Returning 404 to user: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:16.014237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d101886c-20ac-4237-a2e0-d06d09205a1d tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8" status: 404 len: 109 microversion: 2.1 time: 0.265583 Jul 19 12:31:16.014926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 13/28] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:31:15 2022] DELETE /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 => generated 109 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:16.033280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-314893116", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:16.054547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Getting quotas for project 2073f419769a42be967d132787f9ad1e. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:31:16.070194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Getting quotas for user 779f59f5eb434a758ee317f72da17fd5 and project 2073f419769a42be967d132787f9ad1e. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:31:16.102266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:31:16.109543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:31:16.116559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] validate_networks() for [('af3e2e9d-40a0-4fc6-a69d-01cb00762ce4', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:31:16.311962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-37842ae0-3934-421c-a6e9-807dfa0bb6b5 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189312 Jul 19 12:31:16.313860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 16/29] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:31:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:31:16.326704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-037ced2e-10ee-42b6-bc74-807e04f1e823 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd994f4d430>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:16.479589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-037ced2e-10ee-42b6-bc74-807e04f1e823 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.162989 Jul 19 12:31:16.480267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 17/30] 10.222.0.13 () {58 vars in 1187 bytes} [Tue Jul 19 12:31:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:16.486752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f915490a-20bb-4dbc-ac66-b3081a91aaa3 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Calling method '.version_select at 0x7fd994f5f430>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:16.612871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-f915490a-20bb-4dbc-ac66-b3081a91aaa3 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] HTTP exception thrown: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f915490a-20bb-4dbc-ac66-b3081a91aaa3 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Request method failure captured: Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 HTTP/1.1 Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qQDgTuDnNjZugGerx1sJB1SXCj2PWKt1zz5zbFSlxU6lk8RlaBnGQtbrmQLWPNSMTQGB1DhnZoGbUP4c_2KTqsZWpbTYNGH6-hprSw86Meie5tvo5EzlDPCV094214xR7x4KNUM1AYcIP7jhuYm7TL7QWVhRtsu9F2iRu4HbEQHar4 Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:31:16.617474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_402f66e81fd14db9ac98506798ba4282", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/402f66e81fd14db9ac98506798ba4282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 402f66e81fd14db9ac98506798ba4282 Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1819008121 Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: b1b1566726794259a515728a31a24a85 Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1819008121-project Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8'} Jul 19 12:31:16.618821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. (HTTP 404) (Request-ID: req-3c85a5a9-391b-42a0-abf0-c27228535ba8) Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:16.619649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:16.620830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 12:31:16.622676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. Jul 19 12:31:16.624724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:16.627402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f915490a-20bb-4dbc-ac66-b3081a91aaa3 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] Returning 404 to user: Volume 6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:16.628367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f915490a-20bb-4dbc-ac66-b3081a91aaa3 tempest-VolumesSnapshotsTestJSON-1819008121 tempest-VolumesSnapshotsTestJSON-1819008121-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8" status: 404 len: 109 microversion: 2.1 time: 0.146989 Jul 19 12:31:16.628928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 18/31] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:16 2022] GET /compute/v2.1/os-volumes/6a54dd5e-2bd8-4fc4-9da2-79f77d8bf7a8 => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:16.649083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a98b1f3c-ab27-48d6-938e-c12e1481e33b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:16.649238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a98b1f3c-ab27-48d6-938e-c12e1481e33b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:16.780991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a98b1f3c-ab27-48d6-938e-c12e1481e33b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:16.810280 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a98b1f3c-ab27-48d6-938e-c12e1481e33b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1215 microversion: 2.1 time: 0.178041 Jul 19 12:31:16.810841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 19/32] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:16 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:16.824682 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-727645eb-17c3-4fae-8b73-0e62f23d9094 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] Calling method '.version_select at 0x7fd994f5f160>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:17.003716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-727645eb-17c3-4fae-8b73-0e62f23d9094 tempest-VolumesTestJSON-1313432886 tempest-VolumesTestJSON-1313432886-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.191657 Jul 19 12:31:17.010967 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 20/33] 10.222.0.13 () {58 vars in 1154 bytes} [Tue Jul 19 12:31:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:17.270474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:31:17.271327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:31:17.271532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:31:17.272266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:31:17.273001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:31:17.294675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:17.295125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:17.295937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:17.298256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:17.349450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:31:17.369187 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for user 62766e7afd01401293df7e08707d6d95 and project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:31:17.417697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:31:17.424099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:31:17.585767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64a577d8-9a34-4e74-b8eb-c6ee7422eb7f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.558698 Jul 19 12:31:17.590067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 14/34] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:31:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:31:17.598715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dbf23eff-6a3d-4e38-a609-ac33443bb3b0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:17.599566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dbf23eff-6a3d-4e38-a609-ac33443bb3b0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:17.819762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dbf23eff-6a3d-4e38-a609-ac33443bb3b0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:17.826737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:17.827351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:17.834965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dbf23eff-6a3d-4e38-a609-ac33443bb3b0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1221 microversion: 2.1 time: 0.241290 Jul 19 12:31:17.835558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 21/35] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:17 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:17.852778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:17.861276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:17.864063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:17.865946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:18.320735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:18.359938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb4bebb7-e0c4-4daa-bb91-32dbff48038a tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1219 microversion: 2.1 time: 0.527939 Jul 19 12:31:18.360644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 15/36] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:17 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1219 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:31:18.852709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:18.853340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:18.870923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:18.871693 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:18.872803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:18.873730 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:19.035164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:19.049250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-412c55c8-f5a9-4cab-ad81-9bf676f4316d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1225 microversion: 2.1 time: 0.199731 Jul 19 12:31:19.050444 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 22/37] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:18 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:19.378150 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:19.378831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:19.389064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:19.391583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:19.393164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:19.402882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:19.498249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:19.510797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8621f2a4-af2c-463b-ace7-d9e4f76cc85b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1267 microversion: 2.1 time: 0.137349 Jul 19 12:31:19.511387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 16/38] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:19 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:20.051270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2c085fc6-febf-41fb-bf8c-da85f1d13fb1 tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Action: 'create', calling method: .version_select at 0x7fd994683700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-37551786", "metadata": {"Type": "work"}}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:20.067417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:20.068656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:20.075327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:20.076094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:20.077077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:20.077674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:20.169007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:20.177302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-656b992a-cd99-4192-8e41-f9b3d1f70bf6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1225 microversion: 2.1 time: 0.114161 Jul 19 12:31:20.177883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 17/39] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:20 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:20.422703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2c085fc6-febf-41fb-bf8c-da85f1d13fb1 tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.632757 Jul 19 12:31:20.424570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 23/40] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jul 19 12:31:19 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 635 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 19 12:31:20.435399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8cb40e6-3445-4dfd-b3ee-30b1657ae3a1 tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Calling method '.version_select at 0x7fd9946b6700>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:20.484947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8cb40e6-3445-4dfd-b3ee-30b1657ae3a1 tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916" status: 200 len: 351 microversion: 2.1 time: 0.053236 Jul 19 12:31:20.486675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 18/41] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:20 2022] GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:20.528257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:20.528877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:20.535639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:20.536097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:20.536901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:20.537370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:20.606602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:20.614617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-24ef573e-6b96-4a03-8a51-4f4b943283f3 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1267 microversion: 2.1 time: 0.090164 Jul 19 12:31:20.617082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 24/42] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:20 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:21.193762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:21.194598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:21.205698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:21.206197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:21.207192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:21.207628 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:21.328647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:21.339234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a36979f2-34c0-4487-aacc-7a30e45b7ec2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1225 microversion: 2.1 time: 0.149161 Jul 19 12:31:21.340985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 19/43] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:21 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:21.497937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b25a30e0-1dca-4afe-a09f-296eaaa7620a tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Calling method '.version_select at 0x7fd99468c550>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:21.578130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b25a30e0-1dca-4afe-a09f-296eaaa7620a tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916" status: 200 len: 351 microversion: 2.1 time: 0.084086 Jul 19 12:31:21.578707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 25/44] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:21 2022] GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:21.633423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:21.635623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:21.646176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:21.649084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:21.650064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:21.651801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:21.823992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:21.832476 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d0990b4-b056-434b-b6e9-379e5dd9a809 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1273 microversion: 2.1 time: 0.202727 Jul 19 12:31:21.838393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 20/45] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:21 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:22.356674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:22.357286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:22.381972 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:22.382805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:22.386081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:22.389246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:22.590903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5bbb36e-6dfe-4142-ba04-b9a731e13b71 tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Calling method '.version_select at 0x7fd994656af0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:22.636172 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:22.653715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0896b18e-9172-45d6-9a96-f1a2c95cd800 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1279 microversion: 2.1 time: 0.300707 Jul 19 12:31:22.654781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 26/46] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:22 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:22.854549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:22.855360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:22.869664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:22.870475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:22.873346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:22.874923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:22.878847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5bbb36e-6dfe-4142-ba04-b9a731e13b71 tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916" status: 200 len: 352 microversion: 2.1 time: 0.291687 Jul 19 12:31:22.880534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 21/47] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:22 2022] GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916 => generated 352 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:31:22.893615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7a2c057e-f11c-4062-adbc-eccf49561f9b tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Calling method '.version_select at 0x7fd9946b6b80>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:23.130661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7a2c057e-f11c-4062-adbc-eccf49561f9b tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916" status: 200 len: 352 microversion: 2.1 time: 0.241303 Jul 19 12:31:23.140227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 22/48] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:22 2022] GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916 => generated 352 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:23.149873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ca325041-379d-40da-8fb0-b6d16482aa7e tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Calling method '.version_select at 0x7fd9946b6c10>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:23.473397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ca325041-379d-40da-8fb0-b6d16482aa7e tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916" status: 202 len: 0 microversion: 2.1 time: 0.327356 Jul 19 12:31:23.475332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 23/49] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:31:23 2022] DELETE /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 12:31:23.483874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4172b285-d673-4d49-928c-9228354831fa tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Calling method '.version_select at 0x7fd994656ca0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:23.712825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-4172b285-d673-4d49-928c-9228354831fa tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] HTTP exception thrown: Volume 17dee461-62a5-4a3f-ad77-0df5d453f916 could not be found. Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4172b285-d673-4d49-928c-9228354831fa tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Request method failure captured: Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916 HTTP/1.1 Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQXtel5fj_U2JrmA_cykWJI_Rg4iNHbYmnDdKlKzy79CBfI1avSRk0edCa1Yn9VYfUAvRtQ9s0fXAhQvJt7LsV_MHMyrdUj-WqL74U9f-lmKwSJf9Gv4n3dY1EBYKpUzUO5VL7y0pEMCmFOIlw5iRjhHAujeYnQ7q3xj5VW-eqPCoY Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: f786a4af41504096919b50d3ccd94e82 Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesGetTestJSON-1992939643 Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:23.714920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f786a4af41504096919b50d3ccd94e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f786a4af41504096919b50d3ccd94e82", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f786a4af41504096919b50d3ccd94e82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f786a4af41504096919b50d3ccd94e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesGetTestJSON-1992939643 Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: f786a4af41504096919b50d3ccd94e82 Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesGetTestJSON-1992939643 Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesGetTestJSON-1992939643-project Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: d26bedbd41de4f0fac9fdfe2ecc0a2ce Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesGetTestJSON-1992939643-project Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Volume 17dee461-62a5-4a3f-ad77-0df5d453f916 could not be found. Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '17dee461-62a5-4a3f-ad77-0df5d453f916'} Jul 19 12:31:23.716931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17dee461-62a5-4a3f-ad77-0df5d453f916 could not be found. (HTTP 404) (Request-ID: req-9aba34c8-3057-49da-859f-5362244a8b10) Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:23.718238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:23.719751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17dee461-62a5-4a3f-ad77-0df5d453f916 could not be found. Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 12:31:23.725660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17dee461-62a5-4a3f-ad77-0df5d453f916 could not be found. Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17dee461-62a5-4a3f-ad77-0df5d453f916 could not be found. Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4172b285-d673-4d49-928c-9228354831fa tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] Returning 404 to user: Volume 17dee461-62a5-4a3f-ad77-0df5d453f916 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4172b285-d673-4d49-928c-9228354831fa tempest-VolumesGetTestJSON-1992939643 tempest-VolumesGetTestJSON-1992939643-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916" status: 404 len: 109 microversion: 2.1 time: 0.238183 Jul 19 12:31:23.727142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 24/50] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:23 2022] GET /compute/v2.1/os-volumes/17dee461-62a5-4a3f-ad77-0df5d453f916 => generated 109 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:23.937509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-18e4a72f-84a7-43b4-9872-741c1ce94539 req-ea04c063-f11b-4ba8-bc00-688f64cc0eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b29d50-f252-4413-b2aa-cdfcca1abd76", "tag": "c3e836ab-cbed-468f-9956-ee3ffb130306"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:23.974045 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-18e4a72f-84a7-43b4-9872-741c1ce94539 req-ea04c063-f11b-4ba8-bc00-688f64cc0eea service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:23.974761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-18e4a72f-84a7-43b4-9872-741c1ce94539 req-ea04c063-f11b-4ba8-bc00-688f64cc0eea service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:24.031951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-18e4a72f-84a7-43b4-9872-741c1ce94539 req-ea04c063-f11b-4ba8-bc00-688f64cc0eea service nova] Creating event network-changed:c3e836ab-cbed-468f-9956-ee3ffb130306 for instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 on hv-cinder-82099 Jul 19 12:31:24.033887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-18e4a72f-84a7-43b4-9872-741c1ce94539 req-ea04c063-f11b-4ba8-bc00-688f64cc0eea service nova] Acquired lock "compute-rpcapi-router" {{(pid=118120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 12:31:24.041677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72041d4-1730-479f-823b-9996191d3209 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:24.043555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72041d4-1730-479f-823b-9996191d3209 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:24.045512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72041d4-1730-479f-823b-9996191d3209 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:24.046647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72041d4-1730-479f-823b-9996191d3209 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:24.085066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.compute.rpcapi [None req-a72041d4-1730-479f-823b-9996191d3209 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 12:31:24.087752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72041d4-1730-479f-823b-9996191d3209 None None] Releasing lock "compute-rpcapi-router" {{(pid=118120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 12:31:24.161046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a72041d4-1730-479f-823b-9996191d3209 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438279 Jul 19 12:31:24.161713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 25/51] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:24.174778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:24.175620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:24.211345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:24.211863 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:24.212691 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:24.213138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:24.283752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:24.303300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0a575cda-d963-45f8-a352-895a9a5e4933 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 1.451755 Jul 19 12:31:24.307116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 27/52] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:22 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:25.330306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:25.331542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:25.358089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:25.366965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:25.368136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:25.368750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:25.801472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:25.812214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-649493e1-588d-4623-aa96-1eac58235c9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 1.648900 Jul 19 12:31:25.825756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 26/53] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:24 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:26.002187 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:26.290062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:26.314814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-41eb8bc4-4189-48bf-b3b1-6883d110d927 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.991494 Jul 19 12:31:26.328666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 28/54] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:25 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:31:26.830864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:26.831859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:26.860386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:26.870925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:26.874552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:26.875961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:27.331426 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:27.332234 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:27.351622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:27.352111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:27.355407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:27.355850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:27.397030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=14 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:27.831652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=10 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:28.623372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:28.633810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dde719c5-4b61-4321-b431-d3fb0df3e033 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 1.306639 Jul 19 12:31:28.641403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:28.651507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4b29e1c-3db5-469a-8fa4-5c9ce85c20b2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 1.826431 Jul 19 12:31:28.652855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 27/55] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:26 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:28.656989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 29/56] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:27 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:29.240348 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-5c75768c-bafc-4ad5-989f-b501aae7940a req-86e454c0-d091-4f4f-8d81-67389e839d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb972a1-7696-480b-989e-4ae3d657aa05", "tag": "f52744ac-07bc-447c-8f13-9019b70b4f22"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:29.258977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-5c75768c-bafc-4ad5-989f-b501aae7940a req-86e454c0-d091-4f4f-8d81-67389e839d18 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:29.260583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-5c75768c-bafc-4ad5-989f-b501aae7940a req-86e454c0-d091-4f4f-8d81-67389e839d18 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:29.291325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-5c75768c-bafc-4ad5-989f-b501aae7940a req-86e454c0-d091-4f4f-8d81-67389e839d18 service nova] Creating event network-changed:f52744ac-07bc-447c-8f13-9019b70b4f22 for instance bbb972a1-7696-480b-989e-4ae3d657aa05 on hv-cinder-82099 Jul 19 12:31:29.304877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-5c75768c-bafc-4ad5-989f-b501aae7940a req-86e454c0-d091-4f4f-8d81-67389e839d18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.648361 Jul 19 12:31:29.307491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 28/57] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:29.675144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:29.676801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:29.678194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:29.679294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:29.698182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:29.699303 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:29.700807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:29.703779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:29.706232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:29.706570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:29.707286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:29.710438 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:30.124769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:30.134836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04d5b718-3ac8-4c63-a594-a0efa2219ea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.467954 Jul 19 12:31:30.147617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:29 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:30.157369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:30.166241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b29828fe-e7ec-49ad-8688-747e4102e237 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.507047 Jul 19 12:31:30.172025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:29 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:31.153802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:31.154514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:31.185976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:31.186877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:31.190017 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:31.190788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:31.399600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:31.408676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-255f9ffb-8038-4c4c-9ce0-c7c69bdc4ae4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.259541 Jul 19 12:31:31.413136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 31/60] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:31 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:31.418098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:31.419394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:31.426169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:31.426732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:31.428117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:31.428795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:31.449541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c5aa97f-c426-49b2-b122-ace9453cbf91 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Action: 'create', calling method: .version_select at 0x7fd9946b69d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1857630996", "metadata": {"Type": "work"}}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c5aa97f-c426-49b2-b122-ace9453cbf91 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Request method failure captured: Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 122 Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQiiO5-jhzIvx5k9UffBGd-Y-Ox-M0VTWjuypt13jq3-xUyXlcpReec8lBsOP0hlvU1vN3G4Z7zNOV3MKI9DR-78xeIR_2yFjhbdOhAiMLXcsWjO5yxAXyfd0r71iVKszooTltQlGzv25_Sqh03VWtwA6dPlVW2Q0ap24W8Am7eYq0 Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:31.464030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_32ebb35f5b164f3ebf13b98fd8a46273", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1b3b49092d254f78b3bcc8d708334d94 Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1857630996", "metadata": {"Type": "work"}}} Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:31.465203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1857630996', 'metadata': {'Type': 'work'}}}} Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise error Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:31.465872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 12:31:31.466999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 12:31:31.467972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 12:31:31.467972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.467972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c5aa97f-c426-49b2-b122-ace9453cbf91 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:31.470836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c5aa97f-c426-49b2-b122-ace9453cbf91 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.367288 Jul 19 12:31:31.477762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 30/61] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jul 19 12:31:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 12:31:31.488144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-b5457d33-f798-4f60-ae7a-0c14eb897d23 req-3ad75556-f426-492c-b1a1-3238ccc4fe79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "773f09f7-2519-4ec4-afe6-2b0d34cb914a", "tag": "f904e264-8882-4dee-af97-b2601553dbb4"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:31.518354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b5457d33-f798-4f60-ae7a-0c14eb897d23 req-3ad75556-f426-492c-b1a1-3238ccc4fe79 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:31.518873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b5457d33-f798-4f60-ae7a-0c14eb897d23 req-3ad75556-f426-492c-b1a1-3238ccc4fe79 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:31.541973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-b5457d33-f798-4f60-ae7a-0c14eb897d23 req-3ad75556-f426-492c-b1a1-3238ccc4fe79 service nova] Creating event network-changed:f904e264-8882-4dee-af97-b2601553dbb4 for instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a on hv-cinder-82099 Jul 19 12:31:31.547543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-b5457d33-f798-4f60-ae7a-0c14eb897d23 req-3ad75556-f426-492c-b1a1-3238ccc4fe79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070343 Jul 19 12:31:31.549202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 31/62] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:31.557350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb2849e4-4edd-4daa-8209-e754b95ec27f tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Action: 'create', calling method: .version_select at 0x7fd9946b65e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1115839666", "metadata": {"Type": "work"}}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb2849e4-4edd-4daa-8209-e754b95ec27f tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Request method failure captured: Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 120 Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQiiO5-jhzIvx5k9UffBGd-Y-Ox-M0VTWjuypt13jq3-xUyXlcpReec8lBsOP0hlvU1vN3G4Z7zNOV3MKI9DR-78xeIR_2yFjhbdOhAiMLXcsWjO5yxAXyfd0r71iVKszooTltQlGzv25_Sqh03VWtwA6dPlVW2Q0ap24W8Am7eYq0 Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:31.560353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_32ebb35f5b164f3ebf13b98fd8a46273", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1b3b49092d254f78b3bcc8d708334d94 Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1115839666", "metadata": {"Type": "work"}}} Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:31.561865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1115839666', 'metadata': {'Type': 'work'}}}} Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise error Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi '0' Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:31.562752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 12:31:31.565005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 12:31:31.568164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 12:31:31.568164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.568164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb2849e4-4edd-4daa-8209-e754b95ec27f tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:31.568164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb2849e4-4edd-4daa-8209-e754b95ec27f tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010938 Jul 19 12:31:31.568164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 32/63] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jul 19 12:31:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 12:31:31.580862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d1720f2-caaa-493a-947a-7c0af87f28e2 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Action: 'create', calling method: .version_select at 0x7fd994656c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1081526641", "metadata": {"Type": "work"}}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d1720f2-caaa-493a-947a-7c0af87f28e2 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Request method failure captured: Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 119 Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQiiO5-jhzIvx5k9UffBGd-Y-Ox-M0VTWjuypt13jq3-xUyXlcpReec8lBsOP0hlvU1vN3G4Z7zNOV3MKI9DR-78xeIR_2yFjhbdOhAiMLXcsWjO5yxAXyfd0r71iVKszooTltQlGzv25_Sqh03VWtwA6dPlVW2Q0ap24W8Am7eYq0 Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:31.583689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_32ebb35f5b164f3ebf13b98fd8a46273", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1b3b49092d254f78b3bcc8d708334d94 Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1081526641", "metadata": {"Type": "work"}}} Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:31.585088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1081526641', 'metadata': {'Type': 'work'}}}} Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise error Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi '' Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:31.586044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 12:31:31.588606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 12:31:31.589703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 12:31:31.589703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.590587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d1720f2-caaa-493a-947a-7c0af87f28e2 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:31.591659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d1720f2-caaa-493a-947a-7c0af87f28e2 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023177 Jul 19 12:31:31.597223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jul 19 12:31:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 12:31:31.605496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6371bf95-0f08-4d51-b034-db90a3bafe70 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Calling method '.version_select at 0x7fd9946568b0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:31.686591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-6371bf95-0f08-4d51-b034-db90a3bafe70 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] HTTP exception thrown: Volume tempest-invalid-178556366 could not be found. Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6371bf95-0f08-4d51-b034-db90a3bafe70 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Request method failure captured: Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-178556366 HTTP/1.1 Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQiiO5-jhzIvx5k9UffBGd-Y-Ox-M0VTWjuypt13jq3-xUyXlcpReec8lBsOP0hlvU1vN3G4Z7zNOV3MKI9DR-78xeIR_2yFjhbdOhAiMLXcsWjO5yxAXyfd0r71iVKszooTltQlGzv25_Sqh03VWtwA6dPlVW2Q0ap24W8Am7eYq0 Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:31.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_32ebb35f5b164f3ebf13b98fd8a46273", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1b3b49092d254f78b3bcc8d708334d94 Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Volume tempest-invalid-178556366 could not be found. Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'tempest-invalid-178556366'} Jul 19 12:31:31.690860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-178556366 could not be found. (HTTP 404) (Request-ID: req-318aeaa7-9ecd-4743-9d3d-0eb543042d26) Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.691497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 12:31:31.692605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-178556366 could not be found. Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:31.693879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-178556366 could not be found. Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-178556366 could not be found. Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6371bf95-0f08-4d51-b034-db90a3bafe70 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Returning 404 to user: Volume tempest-invalid-178556366 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6371bf95-0f08-4d51-b034-db90a3bafe70 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-178556366" status: 404 len: 98 microversion: 2.1 time: 0.092825 Jul 19 12:31:31.697190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 34/65] 10.222.0.13 () {58 vars in 1214 bytes} [Tue Jul 19 12:31:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-178556366 => generated 98 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 12:31:31.707105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a629ac35-0a26-4249-8915-65db77fe2929 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008025 Jul 19 12:31:31.714400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 35/66] 10.222.0.13 () {58 vars in 1139 bytes} [Tue Jul 19 12:31:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 12:31:31.725494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9187dc16-74b1-42b7-9c3f-8f6b610ee9c0 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009632 Jul 19 12:31:31.732266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 36/67] 10.222.0.13 () {58 vars in 1136 bytes} [Tue Jul 19 12:31:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 12:31:31.747302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d0ce7f-4884-4b89-8d1f-b044a1704d9a tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Calling method '.version_select at 0x7fd9946b6dc0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:31.763220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:31.775776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-de05c5cb-f551-48dd-8ef8-1e3409b3864f tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.361298 Jul 19 12:31:31.777394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 32/68] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:31 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:31.821469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-99d0ce7f-4884-4b89-8d1f-b044a1704d9a tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] HTTP exception thrown: Volume ad8b9b6b-91e6-40e4-bddf-50507966db36 could not be found. Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d0ce7f-4884-4b89-8d1f-b044a1704d9a tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Request method failure captured: Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/os-volumes/ad8b9b6b-91e6-40e4-bddf-50507966db36 HTTP/1.1 Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQiiO5-jhzIvx5k9UffBGd-Y-Ox-M0VTWjuypt13jq3-xUyXlcpReec8lBsOP0hlvU1vN3G4Z7zNOV3MKI9DR-78xeIR_2yFjhbdOhAiMLXcsWjO5yxAXyfd0r71iVKszooTltQlGzv25_Sqh03VWtwA6dPlVW2Q0ap24W8Am7eYq0 Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:31:31.824077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_32ebb35f5b164f3ebf13b98fd8a46273", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1b3b49092d254f78b3bcc8d708334d94 Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Volume ad8b9b6b-91e6-40e4-bddf-50507966db36 could not be found. Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'ad8b9b6b-91e6-40e4-bddf-50507966db36'} Jul 19 12:31:31.825424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad8b9b6b-91e6-40e4-bddf-50507966db36 could not be found. (HTTP 404) (Request-ID: req-390cecc1-fd9e-401d-9aa1-fe41f9f40596) Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.826502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 12:31:31.827694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad8b9b6b-91e6-40e4-bddf-50507966db36 could not be found. Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 12:31:31.829930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad8b9b6b-91e6-40e4-bddf-50507966db36 could not be found. Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad8b9b6b-91e6-40e4-bddf-50507966db36 could not be found. Jul 19 12:31:31.831811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.834103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d0ce7f-4884-4b89-8d1f-b044a1704d9a tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Returning 404 to user: Volume ad8b9b6b-91e6-40e4-bddf-50507966db36 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:31.835409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99d0ce7f-4884-4b89-8d1f-b044a1704d9a tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ad8b9b6b-91e6-40e4-bddf-50507966db36" status: 404 len: 109 microversion: 2.1 time: 0.101954 Jul 19 12:31:31.842605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 37/69] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:31:31 2022] DELETE /compute/v2.1/os-volumes/ad8b9b6b-91e6-40e4-bddf-50507966db36 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:31.850265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b08e3ce8-5fe8-498e-b2d4-b6bc98631666 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Calling method '.version_select at 0x7fd9946663a0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:31.897914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-b08e3ce8-5fe8-498e-b2d4-b6bc98631666 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] HTTP exception thrown: Volume a1e26b27-cba4-4054-a943-cd0c90dc5e53 could not be found. Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b08e3ce8-5fe8-498e-b2d4-b6bc98631666 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Request method failure captured: Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/os-volumes/a1e26b27-cba4-4054-a943-cd0c90dc5e53 HTTP/1.1 Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qQiiO5-jhzIvx5k9UffBGd-Y-Ox-M0VTWjuypt13jq3-xUyXlcpReec8lBsOP0hlvU1vN3G4Z7zNOV3MKI9DR-78xeIR_2yFjhbdOhAiMLXcsWjO5yxAXyfd0r71iVKszooTltQlGzv25_Sqh03VWtwA6dPlVW2Q0ap24W8Am7eYq0 Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:31:31.904275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_32ebb35f5b164f3ebf13b98fd8a46273", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/32ebb35f5b164f3ebf13b98fd8a46273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 32ebb35f5b164f3ebf13b98fd8a46273 Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesNegativeTest-1959127267 Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 1b3b49092d254f78b3bcc8d708334d94 Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesNegativeTest-1959127267-project Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Volume a1e26b27-cba4-4054-a943-cd0c90dc5e53 could not be found. Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'a1e26b27-cba4-4054-a943-cd0c90dc5e53'} Jul 19 12:31:31.905414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1e26b27-cba4-4054-a943-cd0c90dc5e53 could not be found. (HTTP 404) (Request-ID: req-774807f2-ddb8-44d3-8be8-df161d66ac67) Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.906131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 12:31:31.907046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1e26b27-cba4-4054-a943-cd0c90dc5e53 could not be found. Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 12:31:31.908565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a1e26b27-cba4-4054-a943-cd0c90dc5e53 could not be found. Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1e26b27-cba4-4054-a943-cd0c90dc5e53 could not be found. Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b08e3ce8-5fe8-498e-b2d4-b6bc98631666 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] Returning 404 to user: Volume a1e26b27-cba4-4054-a943-cd0c90dc5e53 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:31:31.909481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b08e3ce8-5fe8-498e-b2d4-b6bc98631666 tempest-VolumesNegativeTest-1959127267 tempest-VolumesNegativeTest-1959127267-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/a1e26b27-cba4-4054-a943-cd0c90dc5e53" status: 404 len: 109 microversion: 2.1 time: 0.064774 Jul 19 12:31:31.912673 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 33/70] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jul 19 12:31:31 2022] GET /compute/v2.1/os-volumes/a1e26b27-cba4-4054-a943-cd0c90dc5e53 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:32.429421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:32.430225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:32.440057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:32.445466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:32.447575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:32.450560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:32.736395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:32.747419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0e4cc470-64e1-4e68-afec-9a0e27945339 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.322014 Jul 19 12:31:32.748605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 38/71] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:32 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:32.798424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:32.799606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:32.811230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:32.813349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:32.814843 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:32.815572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:33.028338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:33.043429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-459ac740-8930-4579-b7e8-11665265e4af tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.251610 Jul 19 12:31:33.045798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 34/72] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:32 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:33.765444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:33.767495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:33.773481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:33.783231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:33.786036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:33.792133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:33.797037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:34.064220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:34.065583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:34.071955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:34.083554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-11ace306-fef6-443c-af11-14d474993ab2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.322060 Jul 19 12:31:34.084763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 39/73] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:33 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:34.088939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:34.089383 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:34.090177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:34.090617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:34.295137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:34.307277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e1f538d7-47c3-4838-8ef6-1167c1ba3106 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.248144 Jul 19 12:31:34.322315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 35/74] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:34 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:35.099946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:35.100618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:35.103636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:35.107228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:35.107886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:35.108840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:35.109442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:35.250584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:35.258433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18fc8c5e-9f7e-4c2d-8c9a-bce3dbb151a5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.162270 Jul 19 12:31:35.259266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 40/75] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:35 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:35.330148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:35.330936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:35.337273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:35.337994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:35.338919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:35.339460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:35.491360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:35.499854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-53e85339-e020-4f10-b473-e8bb15634e55 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.173762 Jul 19 12:31:35.500506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 36/76] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:35 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:36.279302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:36.280368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:36.288312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:36.288853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:36.289720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:36.290232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:36.452646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:36.463437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dcc82fd7-4ba3-4b6f-bf13-e029e4ef5e0e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.189627 Jul 19 12:31:36.465271 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 41/77] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:36 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:36.516026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:36.516851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:36.523605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:36.524163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:36.525234 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:36.525903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:36.673164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:36.681552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-aca0bc16-6dd5-4415-aeb3-b51414c8debc tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.169595 Jul 19 12:31:36.682129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 37/78] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:36 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:37.481031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:37.481637 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:37.488392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:37.488843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:37.489603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:37.490092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:37.640033 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:37.651008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2883323-d2f4-47aa-91b3-4e113c5f844a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.173805 Jul 19 12:31:37.652715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 42/79] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:37 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:37.701211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:37.702685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:37.710639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:37.711302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:37.712677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:37.713757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:37.875566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:37.886656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b4e87c2f-99b6-4d22-a370-9b7aae58a194 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.190695 Jul 19 12:31:37.887497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 38/80] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:37 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:38.669710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:38.670353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:38.677655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:38.678116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:38.678926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:38.679500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:38.821217 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:38.831845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-467fc4f1-0b70-4139-9b4e-298fd0ee8111 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.165927 Jul 19 12:31:38.833156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 43/81] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:38 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:38.907758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:38.909556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:38.918471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:38.921161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:38.922230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:38.924120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:39.089945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:39.098191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2458c209-80f6-4591-9786-03858f1e9994 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.197836 Jul 19 12:31:39.098695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 39/82] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:38 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:39.849024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:39.849643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:39.855936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:39.856434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:39.857211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:39.857662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:39.877283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:40.010152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:40.018470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38b5c90f-d655-4707-bde9-6fa069dbf6f3 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.173176 Jul 19 12:31:40.027999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 44/83] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:39 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:40.118770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:40.119410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:40.128269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:40.129349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:40.130314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:40.130893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:40.300878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:40.308606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9bfd3eaa-1ef4-4d4a-ba93-14d9bff64ec4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.197209 Jul 19 12:31:40.309174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 40/84] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:40 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:41.035809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:41.036574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:41.042536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:41.042982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:41.043741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:41.044171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:41.193046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:41.200427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-065a0ecb-d7a2-45be-9ec7-0a530e5b0517 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.169107 Jul 19 12:31:41.201000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 45/85] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:41 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:41.327077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:41.327769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:41.330285 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:41.336353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:41.336816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:41.338934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:41.339385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:41.344950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=99 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:41.513446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:41.520969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-21d0ed99-e36e-46a8-95c8-e4a3e419ed29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.198749 Jul 19 12:31:41.521738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 41/86] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:41 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:42.217404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:42.217934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:42.224564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:42.225012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:42.225771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:42.226207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:42.358655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:42.366920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-155e0f63-0b8d-441e-bf89-612fba2a358e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.153233 Jul 19 12:31:42.375961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 46/87] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:42 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:31:42.539090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:42.539800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:42.545781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:42.546300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:42.547129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:42.547626 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:42.674516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:42.681833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1c9bbc49-cf98-4c57-9ffb-f8e186f71bb6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.146559 Jul 19 12:31:42.682385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 42/88] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:42 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:43.383350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:43.383956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:43.390588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:43.391075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:43.391840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:43.392305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:43.528609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:43.537153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-470622f6-fb60-4fb3-8b3a-bdaabbc35372 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.157493 Jul 19 12:31:43.537904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 47/89] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:43 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:43.699808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:43.700531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:43.707318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:43.707848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:43.708760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:43.709198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:43.840202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:43.848236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7f88546c-e1a0-4cb4-aa84-a3aecc237af8 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.152555 Jul 19 12:31:43.848802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 43/90] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:43 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:44.553521 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:44.554180 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:44.559976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:44.560460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:44.561213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:44.561645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:44.709522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:44.715424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36025c81-2519-43b6-ad72-ad804ee0d86c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.165597 Jul 19 12:31:44.716027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 48/91] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:44 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:44.864084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:44.864678 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:44.871203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:44.871648 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:44.872436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:44.872863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:44.995241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:45.002778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-95ab0711-57f2-458e-acd8-28b5e4717e77 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.142734 Jul 19 12:31:45.003342 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 44/92] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:44 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:45.732948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:45.734231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:45.742869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:45.743319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:45.744270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:45.744709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:45.870565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:45.878275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa68d7c2-b277-4939-8119-f915eafb73b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.149630 Jul 19 12:31:45.879216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 49/93] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:45 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:46.019214 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:46.019819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:46.025871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:46.026259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:46.027014 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:46.027453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:46.155081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:46.162391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9845686e-97a1-49f8-a4a7-a69a9d54fe65 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.147564 Jul 19 12:31:46.162951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 45/94] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:46 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:46.904231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:46.906121 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:46.919508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:46.931478 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:46.934102 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:46.934898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:47.167943 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:47.179632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d50a52fb-be77-4ee3-a494-6a4c6aaaba3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.286062 Jul 19 12:31:47.180312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 50/95] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:46 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:47.180486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:47.181200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:47.191834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:47.192534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:47.193944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:47.194568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:47.283671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-bfc0f80c-25ac-4491-9048-5831c4198de0 req-368e0611-593f-4c82-8d01-c95e4f02b58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b29d50-f252-4413-b2aa-cdfcca1abd76", "name": "network-vif-plugged", "status": "completed", "tag": "c3e836ab-cbed-468f-9956-ee3ffb130306"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:47.293404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-bfc0f80c-25ac-4491-9048-5831c4198de0 req-368e0611-593f-4c82-8d01-c95e4f02b58c service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:47.297000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-bfc0f80c-25ac-4491-9048-5831c4198de0 req-368e0611-593f-4c82-8d01-c95e4f02b58c service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:47.315910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-bfc0f80c-25ac-4491-9048-5831c4198de0 req-368e0611-593f-4c82-8d01-c95e4f02b58c service nova] Creating event network-vif-plugged:c3e836ab-cbed-468f-9956-ee3ffb130306 for instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 on hv-cinder-82099 Jul 19 12:31:47.322154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-bfc0f80c-25ac-4491-9048-5831c4198de0 req-368e0611-593f-4c82-8d01-c95e4f02b58c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139331 Jul 19 12:31:47.323058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 51/96] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:47.352904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:47.361809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6bd3a893-4f68-418a-8eb0-ac53415f5ffa tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.186705 Jul 19 12:31:47.362416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 46/97] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:47 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:48.199201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:48.200504 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:48.207449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:48.207962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:48.208831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:48.209296 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:48.356555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:48.364252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7228d241-ca24-4a84-9bfd-895374a923a7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.171408 Jul 19 12:31:48.365062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 52/98] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:48 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:48.379752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:48.380512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:48.387018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:48.387589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:48.388602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:48.389033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:48.540366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:48.548566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f843241d-f9e2-4cab-b5a3-c2ea284b60cb tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.173395 Jul 19 12:31:48.549224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 47/99] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:48 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:49.381685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:49.383043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:49.396305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:49.397959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:49.399556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:49.400103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:49.539018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:49.548259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4ac5696-d372-49f0-8025-8679c4acda40 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.170049 Jul 19 12:31:49.549164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 53/100] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:49 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:49.566828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:49.568637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:49.577336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:49.578348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:49.579027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:49.580096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:49.757410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:49.765684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3d6e9562-ab5d-440e-8746-bd1d285084c4 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.204408 Jul 19 12:31:49.767117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 48/101] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:49 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:50.566960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:50.567721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:50.576925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:50.577692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:50.578574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:50.579513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:50.783754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:50.785013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:50.791760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:50.792415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:50.793347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:50.793923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:50.826888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:50.837513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9a09e05-a26e-4017-a847-4a808ad8aee2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.276451 Jul 19 12:31:50.848503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 54/102] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:50 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:50.981397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:50.998817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f72764ae-4fb3-4c1a-8ca6-cb85c5a10f62 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.212429 Jul 19 12:31:51.010513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 49/103] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:50 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:51.858216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:51.859779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:51.869847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:51.870549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:51.871759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:51.872630 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:52.018682 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:52.019391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:52.027222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:52.028256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:52.029393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:52.029917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:52.146851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:52.155719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8487d55-75b2-40fb-9aee-c888b6df1709 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.304125 Jul 19 12:31:52.156450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 55/104] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:51 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:52.229448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:52.239986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b2c492eb-026e-4b34-8da6-fed898573f2e tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.226480 Jul 19 12:31:52.240946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 50/105] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:52 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:52.959825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-03c30cf6-b08a-43c9-a436-b972bdad4010 req-459f2dad-f15e-47f7-af36-a103e8012325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb972a1-7696-480b-989e-4ae3d657aa05", "name": "network-vif-plugged", "status": "completed", "tag": "f52744ac-07bc-447c-8f13-9019b70b4f22"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:52.974970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-03c30cf6-b08a-43c9-a436-b972bdad4010 req-459f2dad-f15e-47f7-af36-a103e8012325 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:52.975907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-03c30cf6-b08a-43c9-a436-b972bdad4010 req-459f2dad-f15e-47f7-af36-a103e8012325 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:52.999685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-03c30cf6-b08a-43c9-a436-b972bdad4010 req-459f2dad-f15e-47f7-af36-a103e8012325 service nova] Creating event network-vif-plugged:f52744ac-07bc-447c-8f13-9019b70b4f22 for instance bbb972a1-7696-480b-989e-4ae3d657aa05 on hv-cinder-82099 Jul 19 12:31:53.021435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-03c30cf6-b08a-43c9-a436-b972bdad4010 req-459f2dad-f15e-47f7-af36-a103e8012325 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072572 Jul 19 12:31:53.023790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 56/106] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:31:53.177874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:53.180434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:53.194956 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:53.195657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:53.196661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:53.197813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:53.264540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:53.265714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:53.278355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:53.278355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:53.279155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:53.281090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:53.849220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:53.861002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fd7aba90-bf14-44ff-b35c-30cd6d2a2e03 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.689601 Jul 19 12:31:53.862597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 51/107] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:53 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:53.870627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:53.878384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-732068a6-c324-462e-8a34-a269034c08d6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.624132 Jul 19 12:31:53.883636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 57/108] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:53 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:31:54.884816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:54.885460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:54.901532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:54.902268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:54.903243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:54.904102 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:54.904684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:54.913435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:54.932574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:54.934084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:54.936876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:54.938514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:55.156509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:55.169863 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:55.177377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5cebeb1e-332f-4ed9-913f-1968a80abef6 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.277391 Jul 19 12:31:55.178176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 58/109] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:54 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:31:55.186900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1f8bf25d-5caa-4b4a-9671-dc6fd755d2e9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.303310 Jul 19 12:31:55.186900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 52/110] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:54 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:55.186900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-725863c8-4977-45ff-9377-e9880d041a53 req-6fc9e2a4-d605-41c9-aef3-d3393df6fc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773f09f7-2519-4ec4-afe6-2b0d34cb914a", "name": "network-vif-plugged", "status": "completed", "tag": "f904e264-8882-4dee-af97-b2601553dbb4"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:31:55.200636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-725863c8-4977-45ff-9377-e9880d041a53 req-6fc9e2a4-d605-41c9-aef3-d3393df6fc39 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:55.201237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-725863c8-4977-45ff-9377-e9880d041a53 req-6fc9e2a4-d605-41c9-aef3-d3393df6fc39 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:55.225417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-725863c8-4977-45ff-9377-e9880d041a53 req-6fc9e2a4-d605-41c9-aef3-d3393df6fc39 service nova] Creating event network-vif-plugged:f904e264-8882-4dee-af97-b2601553dbb4 for instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a on hv-cinder-82099 Jul 19 12:31:55.226205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-725863c8-4977-45ff-9377-e9880d041a53 req-6fc9e2a4-d605-41c9-aef3-d3393df6fc39 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 12:31:55.227575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ec49ba81-42fd-4f58-9b21-71e9dfbdc3b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:55.228094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ec49ba81-42fd-4f58-9b21-71e9dfbdc3b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:55.229016 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ec49ba81-42fd-4f58-9b21-71e9dfbdc3b5 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:55.229538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ec49ba81-42fd-4f58-9b21-71e9dfbdc3b5 None None] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:55.238774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.compute.rpcapi [None req-ec49ba81-42fd-4f58-9b21-71e9dfbdc3b5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 12:31:55.239650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ec49ba81-42fd-4f58-9b21-71e9dfbdc3b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 12:31:55.257090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ec49ba81-42fd-4f58-9b21-71e9dfbdc3b5 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075913 Jul 19 12:31:55.258106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 53/111] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:31:56.195532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:56.198811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:56.204134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:56.204921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:56.206741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:56.207825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:56.209401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:56.210012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:56.219050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:56.220170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:56.222020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:56.222448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:56.543401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:56.558719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cac48f40-1cbe-4616-ab43-c0da34066846 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1315 microversion: 2.1 time: 0.367646 Jul 19 12:31:56.569105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:56.571386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 59/112] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:56 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:56.579214 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3ac7889c-bbdc-48cf-a546-78807bebfa9c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.379181 Jul 19 12:31:56.585638 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 54/113] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:56 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:57.577050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:57.577744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:57.584198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:57.584658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:57.585424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:57.585857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:57.598144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:57.599706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:57.607206 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:57.608028 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:57.609416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:57.610653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:57.814685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:57.821166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:57.826631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86ba7744-1418-4610-a3b4-9d3edc043f29 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1501 microversion: 2.1 time: 0.253531 Jul 19 12:31:57.827186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 60/114] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:57 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:31:57.830007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d360f447-277e-4d19-8899-46795ca3f1ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.237075 Jul 19 12:31:57.830723 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 55/115] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:57 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:31:58.846841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:31:58.847498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:31:58.853978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:58.854432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:58.855207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:31:58.855642 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:31:58.987045 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:31:58.994306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7761442b-f1b2-44e7-a6be-7084e2d7c985 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.151944 Jul 19 12:31:58.994864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 61/116] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:31:58 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:00.016236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:00.016236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:00.035078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:00.035645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:00.037744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:00.037744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:00.179090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:00.186920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e47b79cf-22f5-4917-8194-73bc32f342a0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1321 microversion: 2.1 time: 0.179179 Jul 19 12:32:00.187611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 56/117] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:00 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:00.646324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-952affdf-4630-4244-b4e4-743b92f5a729 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95b30201-c0f4-4bd9-adf0-0f42b523c914"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:00.647495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-952affdf-4630-4244-b4e4-743b92f5a729 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:00.653654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-952affdf-4630-4244-b4e4-743b92f5a729 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:00.654182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-952affdf-4630-4244-b4e4-743b92f5a729 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:00.655031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-952affdf-4630-4244-b4e4-743b92f5a729 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:00.655544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-952affdf-4630-4244-b4e4-743b92f5a729 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:00.716825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:01.204788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:01.205977 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:01.212441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:01.213075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:01.214025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:01.214617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:01.385593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:01.398556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e1fb5d9e-567a-4309-90d5-385c2dc80fba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1515 microversion: 2.1 time: 0.197409 Jul 19 12:32:01.400414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 57/118] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:01 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:01.430975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:01.432550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:01.457639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:01.458598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:01.459951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:01.461697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:01.507605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:01.586813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lazy-loading 'flavor' on Instance uuid 773f09f7-2519-4ec4-afe6-2b0d34cb914a {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:32:01.727690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ad567779-db38-4ef3-8c9d-c6f0eb0f4f2f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a/action" status: 200 len: 32 microversion: 2.1 time: 0.312678 Jul 19 12:32:01.728739 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 58/119] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 12:32:01 2022] POST /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a/action => generated 32 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 12:32:01.738932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:01.739643 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:01.746476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:01.747062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:01.748054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:01.748690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:01.961636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:01.970997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-347dd095-9a8a-4815-b090-5fe81afad2a9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.237252 Jul 19 12:32:01.973093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 59/120] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:01 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:02.155901 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-952affdf-4630-4244-b4e4-743b92f5a729 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "POST /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.511428 Jul 19 12:32:02.157111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 62/121] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 12:32:00 2022] POST /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05/os-volume_attachments => generated 194 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:02.990353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:02.991278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:02.998428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:02.998970 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:03.000349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:03.000871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:03.230315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:03.241685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7f8a98c8-08ae-4972-9ab6-c10ba423377a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.256350 Jul 19 12:32:03.242776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 60/122] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:02 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:04.260975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:04.261810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:04.277447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=48 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:04.281198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:04.282184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:04.283387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:04.283872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:04.502914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:04.512285 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a304b934-b060-49de-b7d8-0876b12e9839 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.256805 Jul 19 12:32:04.514321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 63/123] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:04 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:05.531424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:05.532041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:05.534926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:05.543010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:05.543462 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:05.544308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:05.544947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:05.790751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:05.801903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-121cdb3a-4367-4ec0-b48a-62f57dca0aca tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.275043 Jul 19 12:32:05.814801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 61/124] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:05 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:06.833270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:06.834437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:06.841461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:06.842036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:06.842876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:06.843384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:07.003579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:07.015606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4cfaaa39-2b1e-4819-b728-053086e79208 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.197370 Jul 19 12:32:07.018025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 64/125] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:06 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:08.034917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:08.036094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:08.042888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:08.043645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:08.044591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:08.045180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:08.193070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:08.201005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-efc18ef9-8eef-4cc7-825d-db233ce4b580 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.169919 Jul 19 12:32:08.201593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 62/126] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:08 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:09.219996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:09.220753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:09.228480 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:09.228931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:09.230207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:09.230613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:09.412494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:09.424228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eaea780b-0760-4652-bffe-f0c729afb2e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.209354 Jul 19 12:32:09.424751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 65/127] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:09 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:10.442161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:10.443300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:10.451824 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:10.455772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:10.457259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:10.461104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:10.724011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:10.745580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-eb1de6fb-3778-49f5-983f-08eee0e93082 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.308239 Jul 19 12:32:10.756605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 63/128] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:10 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:11.771558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:11.772707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:11.779492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:11.780258 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:11.781663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:11.782322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:11.994394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:12.006861 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-320cea96-daaa-49b1-ac47-30b583c4c497 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.238631 Jul 19 12:32:12.007474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 66/129] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:11 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:12.229710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:12.230886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:12.238240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=46 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:12.241445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:12.242416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:12.243919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:12.244811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:12.275158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Going to try to terminate instance {{(pid=118119) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:32:12.379288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a9c663e1-33fe-4bb6-b1fc-d588ca4a4f02 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 204 len: 0 microversion: 2.1 time: 0.155921 Jul 19 12:32:12.380250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 64/130] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:32:12 2022] DELETE /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:32:12.388106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:12.388953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:12.395968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:12.396518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:12.397289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:12.397720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:12.566293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:12.574659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d7c0136e-283e-4aae-9954-613080da132c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1553 microversion: 2.1 time: 0.190199 Jul 19 12:32:12.575250 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 67/131] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:12 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:13.030923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:13.043158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:13.050300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:13.051473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:13.053071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:13.053622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:13.200450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:13.208441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-de650203-da2e-408f-b912-9bf17459e0b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.183370 Jul 19 12:32:13.218296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 65/132] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:13 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:13.591624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:13.592207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:13.600305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:13.601007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:13.601787 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:13.602223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:13.733852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:13.741856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2741d78e-192c-42cb-9acb-1e1d1ee10334 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1553 microversion: 2.1 time: 0.154313 Jul 19 12:32:13.742431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 68/133] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:13 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:14.225355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:14.226280 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:14.232377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:14.232829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:14.233596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:14.234033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:14.364983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:14.373684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-36e2dd30-91cc-4f91-b2d6-7e55bce7e98e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.151563 Jul 19 12:32:14.374615 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 66/134] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:14 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:14.759522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:14.760052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:14.767246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:14.767699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:14.768527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:14.769096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:14.912751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:14.921018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-690f704c-e6ef-4bed-9de1-894775e42354 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1553 microversion: 2.1 time: 0.165703 Jul 19 12:32:14.921587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 69/135] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:14 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:15.391293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:15.392749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:15.398976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:15.399418 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:15.400202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:15.400650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:15.530442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:15.538194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-04f6b22b-ab4b-400a-9937-3b998315765e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.151638 Jul 19 12:32:15.538750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 67/136] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:15 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:15.939286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:15.939918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:15.946392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:15.946842 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:15.947606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:15.948044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:16.073995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:16.082401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4aaad89-fd5a-4620-9e85-f3977c26bc16 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1553 microversion: 2.1 time: 0.147676 Jul 19 12:32:16.082987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 70/137] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:15 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:16.447979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1446103157", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "networks": [{"uuid": "4fdf1383-4f20-4ff6-b31f-2bbeec76b2a2"}]}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:16.555879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:16.556564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:16.566105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:16.566783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:16.567629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:16.568292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:16.736524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:16.745398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f631849b-bc86-4eff-a6df-04c4721dbe38 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.194144 Jul 19 12:32:16.749581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 71/138] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:16 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:17.101396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:17.102108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:17.114508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:17.115054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:17.115955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:17.116594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:17.194625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:17.207284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b321b589-95bc-415d-be86-9e25adf9760c tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1511 microversion: 2.1 time: 0.111490 Jul 19 12:32:17.209106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 72/139] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:17 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:17.224363 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-24681eb3-7fa0-4d1b-8955-25193d17f652 req-f1cd6076-627c-40f9-9b9e-f3deb95ff155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb972a1-7696-480b-989e-4ae3d657aa05", "name": "network-vif-deleted", "tag": "f52744ac-07bc-447c-8f13-9019b70b4f22"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:17.240594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-24681eb3-7fa0-4d1b-8955-25193d17f652 req-f1cd6076-627c-40f9-9b9e-f3deb95ff155 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:17.241254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-24681eb3-7fa0-4d1b-8955-25193d17f652 req-f1cd6076-627c-40f9-9b9e-f3deb95ff155 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:17.256805 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-24681eb3-7fa0-4d1b-8955-25193d17f652 req-f1cd6076-627c-40f9-9b9e-f3deb95ff155 service nova] Creating event network-vif-deleted:f52744ac-07bc-447c-8f13-9019b70b4f22 for instance bbb972a1-7696-480b-989e-4ae3d657aa05 on hv-cinder-82099 Jul 19 12:32:17.262274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-24681eb3-7fa0-4d1b-8955-25193d17f652 req-f1cd6076-627c-40f9-9b9e-f3deb95ff155 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051605 Jul 19 12:32:17.262808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 73/140] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:17.646134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] validate_networks() for [('4fdf1383-4f20-4ff6-b31f-2bbeec76b2a2', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:32:17.767408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:17.767984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:17.774305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:17.774752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:17.775520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:17.775951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:17.985708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:17.994958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a95a2a04-f42c-4938-801e-4e7e71280ec6 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.233021 Jul 19 12:32:17.995739 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 74/141] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:17 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:18.075415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:32:18.075867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:32:18.076566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:32:18.077134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:32:18.077661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:32:18.087049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:18.087461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:18.088275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:18.088710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:18.105506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Getting quotas for project 7c5a1bf2e2af4328ab3f1b68b4160b7b. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:32:18.110161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Getting quotas for user f832895e13784dfaa69b44505da8855b and project 7c5a1bf2e2af4328ab3f1b68b4160b7b. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:32:18.121186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:32:18.123457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:32:18.179203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4a5c636b-32cc-477f-af85-3108eb7c2d1b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.735099 Jul 19 12:32:18.180853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 68/142] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:32:18.190936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7854f87c-a022-4e98-82d4-0b478282a70d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:18.191608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7854f87c-a022-4e98-82d4-0b478282a70d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:18.224813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:18.225716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:18.231862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:18.232348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:18.233273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:18.233723 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:18.250514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7854f87c-a022-4e98-82d4-0b478282a70d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:18.259047 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7854f87c-a022-4e98-82d4-0b478282a70d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1214 microversion: 2.1 time: 0.072934 Jul 19 12:32:18.259635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 75/143] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:18 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:18.268083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:18.268555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:18.269006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lazy-loading 'fault' on Instance uuid bbb972a1-7696-480b-989e-4ae3d657aa05 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:32:18.465871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:18.474019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9ff51a17-2337-4567-8b34-49dfafc89330 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1351 microversion: 2.1 time: 0.253193 Jul 19 12:32:18.474586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 69/144] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:18 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:19.012946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:19.013827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:19.020509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:19.021194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:19.021958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:19.022565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:19.195392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:19.215944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6fd86d2-00f7-488c-b27f-ce340f0ec87f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.206905 Jul 19 12:32:19.216565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 76/145] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:19 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:19.275239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:19.276018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:19.282755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:19.283285 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:19.284144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:19.284675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:19.348872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:19.356637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7d0e3128-ba13-45c9-a48d-46b9ec65aaad tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1218 microversion: 2.1 time: 0.085245 Jul 19 12:32:19.357217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 70/146] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:19 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:19.490980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:19.491609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:19.497494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:19.497937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:19.498696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:19.499128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:19.529961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:19.530407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:19.530859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lazy-loading 'fault' on Instance uuid bbb972a1-7696-480b-989e-4ae3d657aa05 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:32:19.576786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:19.585315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c403f494-22b7-4ccb-94a1-3f66503cd30b tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1351 microversion: 2.1 time: 0.098049 Jul 19 12:32:19.585893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 77/147] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:19 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:20.233229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:20.233850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:20.240751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:20.241208 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:20.241978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:20.242419 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:20.257273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:20.374189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:20.375973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:20.376599 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:20.383773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f3e00678-ea1e-41d6-b770-ce07348c969f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.154346 Jul 19 12:32:20.384390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 71/148] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:20 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:20.384823 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:20.385277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:20.386051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:20.386487 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:20.447264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:20.455216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a0b8f627-e925-4bbd-8543-3e08fd09d3d1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1218 microversion: 2.1 time: 0.083399 Jul 19 12:32:20.455719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 78/149] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:20 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:20.602176 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:20.602806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:20.608864 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:20.609374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:20.610141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:20.610581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:20.641537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:20.642020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:20.642463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lazy-loading 'fault' on Instance uuid bbb972a1-7696-480b-989e-4ae3d657aa05 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:32:20.681683 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779f59f5eb434a758ee317f72da17fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073f419769a42be967d132787f9ad1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:20.690456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-77aa8c38-630d-4220-b5f0-2135990ce689 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 200 len: 1351 microversion: 2.1 time: 0.092048 Jul 19 12:32:20.691016 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 72/150] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:20 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:21.304252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1227590576", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:21.356626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] validate_networks() for None {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:32:21.403266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:21.404477 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:21.411596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.412033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.413104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.413538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.714488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:21.723185 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a55e8a95-e7be-4454-8bd7-2a2aa1ed8991 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.324576 Jul 19 12:32:21.723759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 73/151] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:21 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:21.737860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:21.738627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:21.745827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.746610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.747638 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.748259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.751888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:32:21.752416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:32:21.752808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:32:21.753217 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:32:21.753627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:32:21.763643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.764503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.765980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.766586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.774268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:21.786578 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Getting quotas for project e9181ed0a5c14a54b7d15417e147ee11. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:32:21.805726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Getting quotas for user c9440928fa144c25a9f959e28cd6e866 and project e9181ed0a5c14a54b7d15417e147ee11. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:32:21.822562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:32:21.825673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:32:21.828226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:21.835887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a116f071-900c-467f-8f2f-721a966cbbe9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1272 microversion: 2.1 time: 0.102519 Jul 19 12:32:21.836497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 74/152] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:21 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:21.850470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:21.851089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:21.857439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.858130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.859663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:21.860133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:21.878282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] HTTP exception thrown: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Request method failure captured: Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 HTTP/1.1 Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qQQDuVJVEzYnzNQzTRVx8HqJr2loNEX1VbuirMztturO0-QLyJuPO2J3lTAPAha2Xn77qhZAczTpp6x8CXSNxYI74kgTXOyKVCXQOYlTsJlYj3aDtcjD7lUhwAKIEhCrvIJKZv8GKkIbcleoPE5IR37p9_pIiIKqQ8ajTHyFWcve8U Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:32:21.883015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2073f419769a42be967d132787f9ad1e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2073f419769a42be967d132787f9ad1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 779f59f5eb434a758ee317f72da17fd5 Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:21.884262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'bbb972a1-7696-480b-989e-4ae3d657aa05'} Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:32:21.885409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:21.886646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:21.891388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Returning 404 to user: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:32:21.891388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-70a3eba4-8f6f-40f0-8d94-c13b59e3352d tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 404 len: 111 microversion: 2.1 time: 0.037907 Jul 19 12:32:21.891388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 75/153] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:21 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:32:21.892034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c6c1253e-1a71-4b96-aa92-28376a86e910 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590514 Jul 19 12:32:21.896587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 79/154] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:32:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:32:21.901687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-75285012-2e23-464f-95bf-0f303daa654e tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:21.902307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-75285012-2e23-464f-95bf-0f303daa654e tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:21.962866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-75285012-2e23-464f-95bf-0f303daa654e tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:21.971612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-75285012-2e23-464f-95bf-0f303daa654e tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1215 microversion: 2.1 time: 0.073879 Jul 19 12:32:21.972447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 76/155] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:21 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:22.056414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:22.058463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:22.073987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:22.074624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:22.075420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:22.076354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:22.094819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] HTTP exception thrown: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Request method failure captured: Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05/os-volume_attachments HTTP/1.1 Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQQDuVJVEzYnzNQzTRVx8HqJr2loNEX1VbuirMztturO0-QLyJuPO2J3lTAPAha2Xn77qhZAczTpp6x8CXSNxYI74kgTXOyKVCXQOYlTsJlYj3aDtcjD7lUhwAKIEhCrvIJKZv8GKkIbcleoPE5IR37p9_pIiIKqQ8ajTHyFWcve8U Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:32:22.100795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2073f419769a42be967d132787f9ad1e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2073f419769a42be967d132787f9ad1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 779f59f5eb434a758ee317f72da17fd5 Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:22.102451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'bbb972a1-7696-480b-989e-4ae3d657aa05'} Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:32:22.103230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:22.104766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:22.107301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Returning 404 to user: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:32:22.108843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6969223-b9a3-45ba-a2a3-07fd73a6efed tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057193 Jul 19 12:32:22.110791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 80/156] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:32:22 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:32:22.739542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:22.740147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:22.746451 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:22.746903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:22.748959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:22.749749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:22.853829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:22.854545 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:22.861176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:22.861707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:22.862594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:22.863198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:22.901551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:22.909938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-371e4435-bc7f-44c7-ae2a-b6f35480dd09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.174220 Jul 19 12:32:22.910803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 77/157] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:22 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:22.990169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:22.990799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:22.998492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.000583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.001718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.002540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.024758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:23.034949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fb88212d-96ae-4385-86ec-50d51408a717 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.185061 Jul 19 12:32:23.035437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 81/158] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:22 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:23.113174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:23.123833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8ea76d59-1940-43b6-8519-40535fba6beb tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1267 microversion: 2.1 time: 0.138578 Jul 19 12:32:23.125378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 78/159] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:22 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:23.216927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-db4f4c1e-d4f3-421d-b12d-ea5fa7e31bef req-48ba8b39-e954-4a99-a561-2e2b4f1dc1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65863ca1-053a-4c82-b8b3-6bb8764a9512", "tag": "21565549-3dcb-488a-be03-2e4162cc1e51"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:23.244403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-db4f4c1e-d4f3-421d-b12d-ea5fa7e31bef req-48ba8b39-e954-4a99-a561-2e2b4f1dc1f6 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.246274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-db4f4c1e-d4f3-421d-b12d-ea5fa7e31bef req-48ba8b39-e954-4a99-a561-2e2b4f1dc1f6 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.267239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-db4f4c1e-d4f3-421d-b12d-ea5fa7e31bef req-48ba8b39-e954-4a99-a561-2e2b4f1dc1f6 service nova] Creating event network-changed:21565549-3dcb-488a-be03-2e4162cc1e51 for instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 on hv-cinder-82099 Jul 19 12:32:23.272632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-db4f4c1e-d4f3-421d-b12d-ea5fa7e31bef req-48ba8b39-e954-4a99-a561-2e2b4f1dc1f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063572 Jul 19 12:32:23.273928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 82/160] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:23.345825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:23.346368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:23.356432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.357053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.357862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.358301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.384701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] HTTP exception thrown: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Request method failure captured: Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 HTTP/1.1 Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qQQDuVJVEzYnzNQzTRVx8HqJr2loNEX1VbuirMztturO0-QLyJuPO2J3lTAPAha2Xn77qhZAczTpp6x8CXSNxYI74kgTXOyKVCXQOYlTsJlYj3aDtcjD7lUhwAKIEhCrvIJKZv8GKkIbcleoPE5IR37p9_pIiIKqQ8ajTHyFWcve8U Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:32:23.386939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2073f419769a42be967d132787f9ad1e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2073f419769a42be967d132787f9ad1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 779f59f5eb434a758ee317f72da17fd5 Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.388552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'bbb972a1-7696-480b-989e-4ae3d657aa05'} Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:32:23.389483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.390651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.392552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Returning 404 to user: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:32:23.393876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-87ac62b1-0da6-43b6-a8d0-b49edd2e7a03 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 404 len: 111 microversion: 2.1 time: 0.052276 Jul 19 12:32:23.400602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 79/161] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:32:23 2022] DELETE /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:32:23.406966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:23.407775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] [instance: bbb972a1-7696-480b-989e-4ae3d657aa05] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:23.415819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.416561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.417424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.417960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.435426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] HTTP exception thrown: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Request method failure captured: Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 HTTP/1.1 Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQQDuVJVEzYnzNQzTRVx8HqJr2loNEX1VbuirMztturO0-QLyJuPO2J3lTAPAha2Xn77qhZAczTpp6x8CXSNxYI74kgTXOyKVCXQOYlTsJlYj3aDtcjD7lUhwAKIEhCrvIJKZv8GKkIbcleoPE5IR37p9_pIiIKqQ8ajTHyFWcve8U Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:32:23.438906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2073f419769a42be967d132787f9ad1e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2073f419769a42be967d132787f9ad1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2073f419769a42be967d132787f9ad1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 2073f419769a42be967d132787f9ad1e Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-DeleteServersTestJSON-266201665 Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 779f59f5eb434a758ee317f72da17fd5 Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-DeleteServersTestJSON-266201665-project Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.440138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'bbb972a1-7696-480b-989e-4ae3d657aa05'} Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:32:23.440811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. Jul 19 12:32:23.441836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:32:23.442767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] Returning 404 to user: Instance bbb972a1-7696-480b-989e-4ae3d657aa05 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:32:23.442767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7995f04e-162c-4ce6-b959-ab3bc79ed593 tempest-DeleteServersTestJSON-266201665 tempest-DeleteServersTestJSON-266201665-project] 10.222.0.13 "GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05" status: 404 len: 111 microversion: 2.1 time: 0.040329 Jul 19 12:32:23.442767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 83/162] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:23 2022] GET /compute/v2.1/servers/bbb972a1-7696-480b-989e-4ae3d657aa05 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:32:23.929045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:23.930436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:23.938327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.939259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:23.940421 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:23.941532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:24.054078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:24.055618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:24.063744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:24.064224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:24.065019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:24.065462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:24.383672 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:24.397414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3888ae9e-65da-4b82-87d7-ae3cd9eb5bd5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.472372 Jul 19 12:32:24.411040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 80/163] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:23 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:24.419485 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:24.420519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:24.429493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:24.430835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:24.432427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:24.432902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:24.470435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:24.478204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-505c2c21-99f9-4413-82c1-d4048fd5a5ff tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.428368 Jul 19 12:32:24.479461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 84/164] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:24 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:24.516460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:24.525564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fd3f9ee6-735d-4d33-986c-76e1b45748fc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1273 microversion: 2.1 time: 0.112426 Jul 19 12:32:24.526158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 81/165] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:24 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:25.416453 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:25.417069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:25.423973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:25.424454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:25.425219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:25.425656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:25.495662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:25.496998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:25.503680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:25.504390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:25.505304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:25.506414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:25.641373 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:25.651883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-653bee4d-6d68-4616-ba74-ad80d240048b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.239345 Jul 19 12:32:25.652497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 85/166] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:25 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:25.665528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:25.666369 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:25.679590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:25.680633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:25.681712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:25.682478 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:25.749722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:25.758382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e9b94519-16a1-42e0-95dc-6c3442fdc46b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.266497 Jul 19 12:32:25.759888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 82/167] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:25 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:25.852276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:25.860269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c352e1ae-dd96-45f0-bdfb-46918572aff1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.199158 Jul 19 12:32:25.860837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 86/168] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:25 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:26.669882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:26.671093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:26.682324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:26.682782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:26.683612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:26.683988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:26.776475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:26.777096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:26.785279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:26.785733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:26.786515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:26.786949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:26.863482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:26.877121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-64448297-9576-45d9-98cd-a932f13ed23f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.211905 Jul 19 12:32:26.877757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 83/169] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:26 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:26.883144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:26.883907 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:26.891280 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:26.891838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:26.892893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:26.893339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:27.034278 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:27.042298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77ce7b96-5dfe-4cab-bcf4-00960d15eaed tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.269519 Jul 19 12:32:27.042880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 87/170] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:26 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:27.066664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:27.074733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4df5b1f8-1369-4f13-a456-5766ebd0652d tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.195332 Jul 19 12:32:27.075316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 84/171] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:26 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:27.895403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:27.896249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:27.903352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:27.908602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:27.909519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:27.910954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:28.036136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-7a6fd486-f619-432a-a299-2e22bdc40d4d req-18778a5e-a26a-411f-a01d-3cf681ecc404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bd0b37-9e8d-42ee-a74d-66cb79522e96", "tag": "f203350e-def1-416d-b638-aa74eaad8178"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:28.047512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-7a6fd486-f619-432a-a299-2e22bdc40d4d req-18778a5e-a26a-411f-a01d-3cf681ecc404 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:28.048420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-7a6fd486-f619-432a-a299-2e22bdc40d4d req-18778a5e-a26a-411f-a01d-3cf681ecc404 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:28.069802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-7a6fd486-f619-432a-a299-2e22bdc40d4d req-18778a5e-a26a-411f-a01d-3cf681ecc404 service nova] Creating event network-changed:f203350e-def1-416d-b638-aa74eaad8178 for instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 on hv-cinder-82099 Jul 19 12:32:28.094543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-7a6fd486-f619-432a-a299-2e22bdc40d4d req-18778a5e-a26a-411f-a01d-3cf681ecc404 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061597 Jul 19 12:32:28.095787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 85/172] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:28.111570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:28.114578 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:28.121827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:28.124053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:28.125625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:28.126620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:28.127340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:28.144748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:28.155291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a17419f-10b7-44c6-8b91-269b24e20ca8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.263674 Jul 19 12:32:28.156584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 88/173] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:27 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:28.164498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:28.167214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:28.176098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:28.176855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:28.179211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:28.179845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:28.450346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:28.467559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d5be49e6-a37e-41bf-8269-73cf5629ea3e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.368437 Jul 19 12:32:28.472634 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:28.480299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 86/174] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:28 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:28.481431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b26a396-751f-4cb9-a18b-6ca8aa9ee018 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.322049 Jul 19 12:32:28.482154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 89/175] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:28 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:29.195733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:29.197120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:29.207726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:29.208948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:29.210306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:29.210949 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:29.471393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:29.487051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:29.487669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:29.489660 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-15ef8d34-c60a-4a58-bc93-cd90f6c03bb1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.321238 Jul 19 12:32:29.490561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 87/176] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:29 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:29.501699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:29.502937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:29.504019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:29.504677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:29.505613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:29.506206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:29.512858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:29.513491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:29.514427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:29.515283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:29.802682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:29.811376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7a3e6401-91fb-4bef-b8ab-280cbafd907a tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.329293 Jul 19 12:32:29.812025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 90/177] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:29 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:29.828554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:29.838042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dc276335-b863-407b-88d0-ec3e74984369 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.342810 Jul 19 12:32:29.839130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 88/178] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:29 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:30.506386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:30.507651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:30.514520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:30.515582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:30.516567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:30.517209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:30.828313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:30.829287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:30.835397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:30.836079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:30.837118 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:30.837558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:31.076657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:31.088065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a65fedcb-c9a9-444c-acea-97d24d7c1cdb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.585495 Jul 19 12:32:31.097891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 91/179] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:30 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:31.097891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:31.097891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:31.108440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:31.108440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:31.108440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:31.108440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:31.128808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:31.138773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-675767b0-41bd-42fb-a83f-1dffe0a66930 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.314242 Jul 19 12:32:31.139357 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 89/180] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:30 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:31.355669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:31.365396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b0763c15-2ae3-489a-ae8a-6febeaa664d1 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.275028 Jul 19 12:32:31.366191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 92/181] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:31 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:32.104862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:32.105466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:32.107403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=8 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:32.134147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:32.134851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:32.135790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:32.136412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:32.156154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:32.156897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:32.173877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:32.179789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=8 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:32.180325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:32.180786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:32.181589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:32.182023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:32.476432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:32.490707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f70110b2-d121-4df6-9044-cbc77e44e624 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.339023 Jul 19 12:32:32.491283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 93/182] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:32 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:32.493440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:32.495739 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:32.495858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:32.506925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-49791c9a-511d-42fe-bb87-dc5812d97e56 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.405483 Jul 19 12:32:32.507193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:32.507680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 90/183] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:32 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:32.513533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:32.513993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:32.515283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:32.515786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:32.687425 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:32.697707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7399f2e0-4d04-467a-8dfd-a908f7fbe2c8 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.205399 Jul 19 12:32:32.698563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 94/184] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:32 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:33.510731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:33.512688 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:33.533596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:33.534213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:33.545493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:33.545953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:33.546826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:33.547259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:33.550120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:33.550816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:33.553566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:33.554242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:33.942987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:33.964588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5942e6c-0a87-4a1f-842a-3fdf737b0752 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.443635 Jul 19 12:32:33.965189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 95/185] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:33 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:33.972705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:33.974377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:33.974984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:33.981948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:33.982147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4964ef68-2e24-44d4-b133-71853af852cf tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.477732 Jul 19 12:32:33.982401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:33.983172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:33.984139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:33.984495 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 91/186] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:33 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:34.200844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:34.211921 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-632c794e-84d1-4503-8930-2a9c97d84ad0 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.243769 Jul 19 12:32:34.212522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 96/187] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:33 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:34.878675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-0bda251c-f7fa-4331-bdd6-1b74484aa792 req-f89060e1-c96e-4b7e-a0fb-138481812014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65863ca1-053a-4c82-b8b3-6bb8764a9512", "name": "network-vif-plugged", "status": "completed", "tag": "21565549-3dcb-488a-be03-2e4162cc1e51"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:34.892131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:34.910198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0bda251c-f7fa-4331-bdd6-1b74484aa792 req-f89060e1-c96e-4b7e-a0fb-138481812014 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:34.912668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0bda251c-f7fa-4331-bdd6-1b74484aa792 req-f89060e1-c96e-4b7e-a0fb-138481812014 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:34.940104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-0bda251c-f7fa-4331-bdd6-1b74484aa792 req-f89060e1-c96e-4b7e-a0fb-138481812014 service nova] Creating event network-vif-plugged:21565549-3dcb-488a-be03-2e4162cc1e51 for instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 on hv-cinder-82099 Jul 19 12:32:34.963043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-0bda251c-f7fa-4331-bdd6-1b74484aa792 req-f89060e1-c96e-4b7e-a0fb-138481812014 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099616 Jul 19 12:32:34.966692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 97/188] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:35.006249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:35.011749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:35.034947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4db77446-c8a4-46a2-be8b-6eabed7de9af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: .version_select at 0x7fd994439700>, body: {"keypair": {"name": "tempest-keypair-526115753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO2eHMlf3rAf+isFYFD+DxKQ3vpvoNTtcEQoFhBP0WOqBlmkflN+tl0R+4xxKcDrkYSBwsTDmQS1EQqxWQS1NraKFqDiiefAzeqC/G/kh2DA+2606dgSKDQxbgBxyx5Ag=="}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:35.040533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:35.041360 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:35.042304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:35.042738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:35.082365 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-4db77446-c8a4-46a2-be8b-6eabed7de9af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:32:35.097378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-4db77446-c8a4-46a2-be8b-6eabed7de9af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:32:35.165951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4db77446-c8a4-46a2-be8b-6eabed7de9af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.393425 Jul 19 12:32:35.166577 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 92/189] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 12:32:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:35.196416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:35.197218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:35.209609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:35.210265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:35.211654 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:35.212295 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:35.390283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:35.403568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1ed947c3-9650-4247-8910-7067f80974ce tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.416767 Jul 19 12:32:35.405870 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 98/190] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:34 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:35.417771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:35.418868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:35.441653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:35.443449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:35.444741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:35.445351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:35.450434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:35.566790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:35.583445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6736f685-8949-4844-9843-2e4dabb0e920 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.413815 Jul 19 12:32:35.596787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 93/191] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:35 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:35.817382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:35.831747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4aa29d27-e22f-4112-abb4-ec1c83c9ac7f tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.423434 Jul 19 12:32:35.832481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 99/192] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:35 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:36.425420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:36.426195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:36.432895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:36.433348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:36.434128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:36.434616 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:36.603657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:36.604222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:36.611434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:36.611889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:36.612689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:36.613398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:36.926630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:36.934440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ae6c7e98-9732-4130-a9fa-3e53c2040639 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.514597 Jul 19 12:32:36.935022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 94/193] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:36 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:36.940364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:36.941305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:36.947720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:36.948366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:36.949441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:36.950175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:37.095928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:37.112729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7e472a4-dc76-47a1-996e-ac33502c96a8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.513182 Jul 19 12:32:37.113357 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 100/194] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:36 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:37.205168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:37.214965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4d51b7c6-a13e-4ac0-882a-6251d2aa1d7c tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.278754 Jul 19 12:32:37.215882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 95/195] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:36 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:37.443878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-763766700", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbcf9e05-75a4-4a6f-9f4c-53034463b4ca"}], "security_groups": [{"name": "tempest-securitygroup--23809486"}], "key_name": "tempest-keypair-526115753", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:37.579337 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] validate_networks() for [('dbcf9e05-75a4-4a6f-9f4c-53034463b4ca', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:32:37.950671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:37.951887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:37.957464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:37.960281 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:37.960749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:37.961536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:37.961975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:38.087005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:32:38.087597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:32:38.088386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:32:38.088944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:32:38.089444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:32:38.099543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:38.100081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:38.101125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:38.101699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:38.119486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:32:38.126142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:32:38.136913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:38.138182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:32:38.141049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:32:38.149280 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-494f468d-f7b1-437d-807a-9608ddad1dfc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.202282 Jul 19 12:32:38.150085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 96/196] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:37 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:38.155006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:38.155914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:38.162696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:38.163990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:38.165011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:38.165662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:38.201467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40369a05-2f7a-4ebb-adf3-44788018af92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.761778 Jul 19 12:32:38.203305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 101/197] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:32:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:32:38.213377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a2a11373-92ed-40a2-8dc4-f82cac762471 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:38.215003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a2a11373-92ed-40a2-8dc4-f82cac762471 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:38.285131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a2a11373-92ed-40a2-8dc4-f82cac762471 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:38.293539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a2a11373-92ed-40a2-8dc4-f82cac762471 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1240 microversion: 2.1 time: 0.084501 Jul 19 12:32:38.294799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 102/198] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:38.306807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:38.307365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:38.316460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:38.317098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:38.318164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:38.318796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:38.404963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:38.413731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bf6ef04a-6db3-4f21-87d9-985962677a4b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.262385 Jul 19 12:32:38.415063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 97/199] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:38 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:38.490719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:38.503475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0ce790de-ab8d-4b64-896d-f1b436899c4a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.207377 Jul 19 12:32:38.504135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 103/200] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:38 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:39.161696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-70fe9571-3123-496b-bea9-0b26b5f9af6a req-a80a9d04-9d7e-4545-bfdf-cb8e395c3fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bd0b37-9e8d-42ee-a74d-66cb79522e96", "name": "network-vif-plugged", "status": "completed", "tag": "f203350e-def1-416d-b638-aa74eaad8178"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:39.165923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:39.166522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:39.171916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-70fe9571-3123-496b-bea9-0b26b5f9af6a req-a80a9d04-9d7e-4545-bfdf-cb8e395c3fbc service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.172528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-70fe9571-3123-496b-bea9-0b26b5f9af6a req-a80a9d04-9d7e-4545-bfdf-cb8e395c3fbc service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.175393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.176113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.177179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.178017 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.185127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-70fe9571-3123-496b-bea9-0b26b5f9af6a req-a80a9d04-9d7e-4545-bfdf-cb8e395c3fbc service nova] Creating event network-vif-plugged:f203350e-def1-416d-b638-aa74eaad8178 for instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 on hv-cinder-82099 Jul 19 12:32:39.192308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-70fe9571-3123-496b-bea9-0b26b5f9af6a req-a80a9d04-9d7e-4545-bfdf-cb8e395c3fbc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Jul 19 12:32:39.193712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 98/201] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:39.313345 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:39.314251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:39.316225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:39.321230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.321957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.322745 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.323295 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.326671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-11209ad6-3e29-4ff5-992c-d0a6ae446543 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.164896 Jul 19 12:32:39.331435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 104/202] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:39 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:39.392022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:39.402264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6653f970-48bf-4478-b798-e2ddd90f66f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1244 microversion: 2.1 time: 0.094478 Jul 19 12:32:39.402841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 99/203] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:39.430786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:39.431319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:39.437881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.438318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.439076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.439511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.520926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:39.521534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:39.527614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.528059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.528850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:39.529287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:39.578766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:39.591852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75977d25-bde5-401a-bb16-1a3eccc8902e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.164839 Jul 19 12:32:39.596892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 105/204] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:39 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:39.666732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:39.674717 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bad01c70-5744-4294-a090-b683bc2e71df tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.157483 Jul 19 12:32:39.675348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 100/205] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:39 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:40.348045 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:40.348873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:40.355339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.355857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.356623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.357060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.418589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:40.419312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:40.426869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.427317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.428083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.428539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.492782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:40.500353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-29fc5529-3d74-4670-8895-39fe6c9a9185 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1236 microversion: 2.1 time: 0.085563 Jul 19 12:32:40.500932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 101/206] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:40.513710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:40.521534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ef65e00-8833-4094-9507-02431abe89ae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.177379 Jul 19 12:32:40.522094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 106/207] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:40 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:40.613331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:40.613870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:40.620000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.620485 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.621251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.621690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.691364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:40.691970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:40.697873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.698321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.699070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:40.699503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:40.797501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:40.804857 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c7e78889-0891-423d-9023-b8d3fb4b917b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.195407 Jul 19 12:32:40.805423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 102/208] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:40 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:40.853467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:40.861316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d209c789-cc56-42e5-9bb2-0a6d79bbd6db tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.173752 Jul 19 12:32:40.861875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 107/209] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:40 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:41.517792 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:41.518402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:41.524430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.524875 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:41.525628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.526058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:41.537791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:41.538399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:41.544729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.545177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:41.546026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.546459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:41.587175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:41.595124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ce16061e-69d8-44ce-8241-002a6a17e033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1236 microversion: 2.1 time: 0.081627 Jul 19 12:32:41.595690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 103/210] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1236 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:41.679192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:41.686712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-abad5859-33fc-49a4-a9bf-594d472e26c5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.152608 Jul 19 12:32:41.687283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 108/211] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:41 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:41.821865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:41.822410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:41.828434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.828892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:41.829659 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.830110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:41.878013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:41.878624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:41.884558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.885011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:41.885770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:41.886206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:42.013292 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:42.025361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-88848f41-ad32-476a-9324-3edccf3704e3 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1314 microversion: 2.1 time: 0.207364 Jul 19 12:32:42.026114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 104/212] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:41 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:42.050906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:42.058383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b65ca24-42a0-4c04-bb37-4efc9607b54a tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.184376 Jul 19 12:32:42.058977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 109/213] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:41 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:42.612719 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:42.613326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:42.624161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:42.624897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:42.625900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:42.626348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:42.691272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:42.698816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-394d7efb-adbc-448e-bda9-1ef40ea59cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1292 microversion: 2.1 time: 0.090502 Jul 19 12:32:42.699382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 105/214] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:42.703065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:42.703851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:42.710394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:42.710838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:42.711601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:42.712021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:42.841138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:42.849246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78ee6ee4-710f-4ab0-bc51-0b58fce86891 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.150047 Jul 19 12:32:42.849801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 110/215] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:42 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:43.043557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:43.043557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:43.051204 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.051559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.052361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.052953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.074792 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:43.075580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:43.082019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.082479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.083255 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.083876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.258976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:43.276228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7315c71b-1474-4c91-9fe8-2c7c34dded03 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1497 microversion: 2.1 time: 0.237061 Jul 19 12:32:43.277452 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 106/216] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:43 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:43.287029 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:43.295425 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d551384-99fe-4bb7-a7ae-d4f60a325e44 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.224036 Jul 19 12:32:43.296048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 111/217] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:43 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:43.716776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:43.717461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:43.724233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.724983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.726180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.726755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.759605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:43.760699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:43.768957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.769656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.770567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.771143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.803860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:32:43.806574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:43.816448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-42a72ede-967f-49b0-a706-7d7137eca342 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1292 microversion: 2.1 time: 0.105115 Jul 19 12:32:43.817342 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 107/218] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:43.865911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:43.866859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:43.874217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.875427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.876268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.877494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.906912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d0533ba3-6bab-45b3-a268-b5dafd93d8c1 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 204 len: 0 microversion: 2.1 time: 0.150810 Jul 19 12:32:43.907700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 112/219] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:32:43 2022] DELETE /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 12:32:43.917131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:43.918058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:43.924639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.925323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:43.926272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:43.926711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:44.085814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:44.100602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c5ace7eb-d53d-4dd7-8bbf-2fad6baa61e4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.238473 Jul 19 12:32:44.101823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 108/220] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:43 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:44.120735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:44.131106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5164fbb8-0f09-4d73-a559-9d9e186291f2 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1503 microversion: 2.1 time: 0.218663 Jul 19 12:32:44.132361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 113/221] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:43 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:44.332266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:44.332853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:44.344463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:44.345105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:44.346222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:44.346639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:44.351091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:44.505048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:44.513269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-91a6f382-53d6-495b-8dea-80d80229a5ae tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.184646 Jul 19 12:32:44.514093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 109/222] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:44 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:44.833206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:44.833813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:44.840610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:44.841062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:44.841818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:44.842256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:44.904686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:44.912293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24052797-eb2f-486e-a6e4-c83fc2a2c380 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1300 microversion: 2.1 time: 0.082844 Jul 19 12:32:44.912990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 114/223] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:45.117738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:45.118356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:45.120232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:45.126622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.127071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:45.127858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.128327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:45.149385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:45.150012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:45.156236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.156920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:45.158074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.158759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:45.339274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:45.347823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8c6c3a1e-c3f2-447c-981e-ac4c9d58551f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.233801 Jul 19 12:32:45.350683 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:45.351387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 110/224] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:45 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:45.363822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:45.368265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f734eb87-5950-4df6-99da-1ec4f18cc905 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1503 microversion: 2.1 time: 0.222610 Jul 19 12:32:45.368840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 115/225] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:45 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:45.538661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:45.539407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:45.546327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.547045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:45.557542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.557542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:45.708881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:45.717033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1d61e1f7-00be-4a0a-bd70-2064cb128af2 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1315 microversion: 2.1 time: 0.188538 Jul 19 12:32:45.718138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 111/226] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:45 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:45.931276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:45.932252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:45.945662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.946286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:45.947135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:45.947599 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:46.018077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:46.026658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5221f3d9-8a5f-4497-a209-90e1d1daeb77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1300 microversion: 2.1 time: 0.100928 Jul 19 12:32:46.027568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 116/227] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:46.368400 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:46.369008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:46.385700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:46.385940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:46.386251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:46.387136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:46.387968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:46.390181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:46.398892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:46.400007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:46.401736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:46.402538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:46.615483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:46.623556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ee25545a-4a4d-4611-903d-39befc3092b4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.259327 Jul 19 12:32:46.625299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 112/228] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:46 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:46.631889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:46.640979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a41d13f8-4b79-405a-a6f7-eca4c9b3b3f9 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1503 microversion: 2.1 time: 0.259326 Jul 19 12:32:46.641818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 117/229] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:46 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:46.752051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:46.756681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:46.779256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:46.779898 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:46.788440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:46.788917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.050631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:47.052264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:47.055255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:47.062289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.063083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.064246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.065015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.069129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-eb974bda-a630-4264-9e21-7ba496c47be4 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1465 microversion: 2.1 time: 0.336357 Jul 19 12:32:47.070090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 113/230] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:46 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1465 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:47.134673 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:47.138372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:47.150502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.151136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.152440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.153310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.188861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Going to try to terminate instance {{(pid=118119) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:32:47.189844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:47.198012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0bccf7c0-7d63-4e4d-964b-e9eec68c4f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1298 microversion: 2.1 time: 0.158488 Jul 19 12:32:47.199136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 118/231] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:47.286576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-95764ae4-7a54-4d9f-94fd-717597e89cfc tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "DELETE /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 204 len: 0 microversion: 2.1 time: 0.153363 Jul 19 12:32:47.287578 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 114/232] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:32:47 2022] DELETE /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 12:32:47.298337 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:47.299001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:47.307602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.308055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.309106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.309537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.568261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:47.577763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b2fa12da-1952-4d9f-a35a-42b37ecfe2cf tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1471 microversion: 2.1 time: 0.285061 Jul 19 12:32:47.587371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 119/233] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:47 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:47.640944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:47.642253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:47.652270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.652829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.653814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.654347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.675754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:47.676671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:47.687308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.687691 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.688542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:47.689540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:47.907479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:47.921675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f2b0d3e8-be11-46b2-bc15-e4bd2d44660f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1503 microversion: 2.1 time: 0.250780 Jul 19 12:32:47.922624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 120/234] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:47 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:47.927112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:47.934985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a36e2b44-2e7c-4f3a-82f0-703970d2bad5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.298358 Jul 19 12:32:47.935584 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 115/235] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:47 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:48.219997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:48.221395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:48.226390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:48.246359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:48.248504 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:48.252486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:48.253434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:48.293100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=8 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:48.390579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:48.411037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e7ec42a-fa51-44fb-a576-6e354f933734 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1298 microversion: 2.1 time: 0.197974 Jul 19 12:32:48.414229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 121/236] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:48.534304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-65b1ba67-baf0-42d3-bc50-8f7075101dfd req-0e12bd3a-437a-48ef-b5a6-043efdbc58c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65863ca1-053a-4c82-b8b3-6bb8764a9512", "name": "network-vif-deleted", "tag": "21565549-3dcb-488a-be03-2e4162cc1e51"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:48.546366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-65b1ba67-baf0-42d3-bc50-8f7075101dfd req-0e12bd3a-437a-48ef-b5a6-043efdbc58c8 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:48.551393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-65b1ba67-baf0-42d3-bc50-8f7075101dfd req-0e12bd3a-437a-48ef-b5a6-043efdbc58c8 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:48.579706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-65b1ba67-baf0-42d3-bc50-8f7075101dfd req-0e12bd3a-437a-48ef-b5a6-043efdbc58c8 service nova] Creating event network-vif-deleted:21565549-3dcb-488a-be03-2e4162cc1e51 for instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 on hv-cinder-82099 Jul 19 12:32:48.590576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-65b1ba67-baf0-42d3-bc50-8f7075101dfd req-0e12bd3a-437a-48ef-b5a6-043efdbc58c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060427 Jul 19 12:32:48.595498 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 116/237] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:48.595966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:48.596979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:48.611652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:48.615667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:48.619271 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:48.622140 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:48.939284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:48.940314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:48.951177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:48.951646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:48.953011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:48.953455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:49.216801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:49.226228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bfe9cfb4-60f2-435f-9556-008e1cce66a7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 200 len: 1299 microversion: 2.1 time: 0.291359 Jul 19 12:32:49.234160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 117/238] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:48 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 1299 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:49.243045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:49.245952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:49.262112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:49.263373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:49.266100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:49.268022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:49.288525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:49.297714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3daf8b07-7d4a-4ca2-be9a-576f6ac01238 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1471 microversion: 2.1 time: 0.706176 Jul 19 12:32:49.301575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 122/239] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:48 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1471 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:49.433094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:49.434018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:49.444573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:49.447034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:49.448240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:49.451803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:49.461841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:49.473610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c1fd1efb-c0a7-4fc4-aedd-2c95fc705f09 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1521 microversion: 2.1 time: 0.237983 Jul 19 12:32:49.474682 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 118/240] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:49 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:49.788421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:49.798800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ca27dfeb-c548-4b06-b8ee-69aab7135a30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 0.371218 Jul 19 12:32:49.800469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 123/241] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:50.246886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:50.248473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 65863ca1-053a-4c82-b8b3-6bb8764a9512] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:50.256421 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:50.257039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:50.257955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:50.258524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:50.272465 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] HTTP exception thrown: Instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 could not be found. Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Request method failure captured: Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 HTTP/1.1 Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qROfA2_wRXLb1krnvIDSIJInPgJyMwPYSKR35Qmg11w85jdJy9Pgw79pZVVPOzvJQmTeFiaGqAL8Pm1ERdkJPTaS8T3bmfd4oWK2nyaMArCZrng5cKPBMuDgJ0gvvUp_lGJ_9p8DhAwgU74bBb4e-OrPMyqSPEEF-jFmlBszcj5PAQ Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 7c5a1bf2e2af4328ab3f1b68b4160b7b Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesActionsTest-1694135667 Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:32:50.274113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c5a1bf2e2af4328ab3f1b68b4160b7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c5a1bf2e2af4328ab3f1b68b4160b7b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c5a1bf2e2af4328ab3f1b68b4160b7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c5a1bf2e2af4328ab3f1b68b4160b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesActionsTest-1694135667 Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 7c5a1bf2e2af4328ab3f1b68b4160b7b Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesActionsTest-1694135667 Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesActionsTest-1694135667-project Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: f832895e13784dfaa69b44505da8855b Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesActionsTest-1694135667-project Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 could not be found. Jul 19 12:32:50.275741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '65863ca1-053a-4c82-b8b3-6bb8764a9512'} Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 could not be found. Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:32:50.276636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 could not be found. Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 could not be found. Jul 19 12:32:50.277983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:50.279238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Returning 404 to user: Instance 65863ca1-053a-4c82-b8b3-6bb8764a9512 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:32:50.279238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9d7fa5b3-48fc-4b77-9e3d-186cf45f979b tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512" status: 404 len: 111 microversion: 2.1 time: 0.033544 Jul 19 12:32:50.290711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 119/242] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:50 2022] GET /compute/v2.1/servers/65863ca1-053a-4c82-b8b3-6bb8764a9512 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:32:50.318486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:50.319203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:50.329100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:50.331245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:50.333515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:50.334275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:50.495366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:50.496261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:50.507521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:50.507978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:50.508809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:50.509246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:50.550766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9440928fa144c25a9f959e28cd6e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9181ed0a5c14a54b7d15417e147ee11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:50.558427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-89172876-c034-433a-9677-29b3b1df9cf9 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 200 len: 1471 microversion: 2.1 time: 0.243680 Jul 19 12:32:50.559658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 124/243] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:50 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:50.565229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-364568304", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "networks": [{"uuid": "4fdf1383-4f20-4ff6-b31f-2bbeec76b2a2"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:50.657311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] validate_networks() for [('4fdf1383-4f20-4ff6-b31f-2bbeec76b2a2', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:32:50.943516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:50.968256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ea9d9b8f-6646-4d74-ba43-052bd98fb501 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1501 microversion: 2.1 time: 0.478865 Jul 19 12:32:50.978105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 120/244] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:50 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1501 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:51.013024 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-a56e6fce-6c64-4f8f-9fae-f1e0d8b689ac req-7bcd85f3-7cb1-4dc4-ad0a-dadeb836b43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3", "tag": "802e451a-2b49-4a6e-a7e6-80c9853cd706"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:51.028825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-a56e6fce-6c64-4f8f-9fae-f1e0d8b689ac req-7bcd85f3-7cb1-4dc4-ad0a-dadeb836b43e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:51.029505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-a56e6fce-6c64-4f8f-9fae-f1e0d8b689ac req-7bcd85f3-7cb1-4dc4-ad0a-dadeb836b43e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:51.054130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-a56e6fce-6c64-4f8f-9fae-f1e0d8b689ac req-7bcd85f3-7cb1-4dc4-ad0a-dadeb836b43e service nova] Creating event network-changed:802e451a-2b49-4a6e-a7e6-80c9853cd706 for instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 on hv-cinder-82099 Jul 19 12:32:51.070628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-a56e6fce-6c64-4f8f-9fae-f1e0d8b689ac req-7bcd85f3-7cb1-4dc4-ad0a-dadeb836b43e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065409 Jul 19 12:32:51.071599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 121/245] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:51.081622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:51.082545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:51.110666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:51.111461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:51.112544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:51.113276 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:51.486680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:51.506348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-08310b08-7cac-4161-b5fd-bd2c7aed128b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 0.426451 Jul 19 12:32:51.507602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 122/246] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:51.556934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:51.560810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:51.571610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:32:51.571610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:32:51.571610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:32:51.571610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:32:51.571610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:32:51.596603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:51.598403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:51.600574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:51.600715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:51.601807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:51.603261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:51.604055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:51.627624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:51.689791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Getting quotas for project 7c5a1bf2e2af4328ab3f1b68b4160b7b. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:32:51.712885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Getting quotas for user f832895e13784dfaa69b44505da8855b and project 7c5a1bf2e2af4328ab3f1b68b4160b7b. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:32:51.748320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:32:51.755833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:32:51.853985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b09f9ee-ea07-405f-93c0-e3e513f948ae tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.293030 Jul 19 12:32:51.854642 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 125/247] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:32:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:32:51.864318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-557274634", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "networks": [{"uuid": "17ad8a1f-844a-4ab8-8940-bf22e9103dfa"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:51.957013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] validate_networks() for [('17ad8a1f-844a-4ab8-8940-bf22e9103dfa', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:32:52.147385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:52.156563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bc3016a4-6db1-489d-8826-fd4118d049fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1515 microversion: 2.1 time: 0.620746 Jul 19 12:32:52.160742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 123/248] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:51 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1515 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:52.180899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:52.184069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] [instance: 08bd0b37-9e8d-42ee-a74d-66cb79522e96] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:52.201061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:52.201551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:52.205653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:52.207872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:52.240859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] HTTP exception thrown: Instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 could not be found. Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Request method failure captured: Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 HTTP/1.1 Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRTg53jFH6iCxDQjh-1yfyeTD1ivpWsjavsKAxB0nl1hnic3c9Zv-zHpYDUJkSaF_mQkbG55m7fGCKMKLIAcDH8mJ6DTDmYHTDFIb9Q5m21gb27hKqPIUZSbPK_UJP9FBNu6sYpJc1HFen7mIkU1XKqfYNdmCzh_edy6tJcZOvNxmw Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: e9181ed0a5c14a54b7d15417e147ee11 Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesNegativeTest-1670098386 Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:32:52.243134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e9181ed0a5c14a54b7d15417e147ee11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e9181ed0a5c14a54b7d15417e147ee11", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e9181ed0a5c14a54b7d15417e147ee11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e9181ed0a5c14a54b7d15417e147ee11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesNegativeTest-1670098386 Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: e9181ed0a5c14a54b7d15417e147ee11 Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesNegativeTest-1670098386 Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesNegativeTest-1670098386-project Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: c9440928fa144c25a9f959e28cd6e866 Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesNegativeTest-1670098386-project Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 could not be found. Jul 19 12:32:52.244405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '08bd0b37-9e8d-42ee-a74d-66cb79522e96'} Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 could not be found. Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:32:52.245258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 could not be found. Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 could not be found. Jul 19 12:32:52.247042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:32:52.252661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] Returning 404 to user: Instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:32:52.253954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-db5aac27-546c-41d0-acf7-a1d615b2cc89 tempest-VolumesNegativeTest-1670098386 tempest-VolumesNegativeTest-1670098386-project] 10.222.0.13 "GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96" status: 404 len: 111 microversion: 2.1 time: 0.092046 Jul 19 12:32:52.254845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 124/249] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:52 2022] GET /compute/v2.1/servers/08bd0b37-9e8d-42ee-a74d-66cb79522e96 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:32:52.266378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0cc30b2a-61c4-4dfe-a74a-bca0320895d7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:52.267162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0cc30b2a-61c4-4dfe-a74a-bca0320895d7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:52.425736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0cc30b2a-61c4-4dfe-a74a-bca0320895d7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:52.439411 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0cc30b2a-61c4-4dfe-a74a-bca0320895d7 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1213 microversion: 2.1 time: 0.179023 Jul 19 12:32:52.441830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 125/250] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:52 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:52.525234 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:52.525880 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:52.537241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:52.537867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:52.538845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:52.540807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:53.146979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:32:53.147776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:32:53.148492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:32:53.148979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:32:53.150365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:32:53.168282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:53.169376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:53.171115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:53.172717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:53.195807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:53.216990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Getting quotas for project 6f6b44bed4904d50b5f1ebfc5ab34743. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:32:53.225931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Getting quotas for user 70c035662359493e86c58a3d40150eb8 and project 6f6b44bed4904d50b5f1ebfc5ab34743. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:32:53.236623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:53.243851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:32:53.249262 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:32:53.253433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e8e88c69-ea23-4415-8bf2-860fc4084eb9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 0.732194 Jul 19 12:32:53.257915 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:53.271043 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-51ef9637-a3ae-4c3d-9029-0529dd7de54c req-8568405e-8530-46ee-a5b9-922279c3b64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bd0b37-9e8d-42ee-a74d-66cb79522e96", "name": "network-vif-deleted", "tag": "f203350e-def1-416d-b638-aa74eaad8178"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:53.293675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-51ef9637-a3ae-4c3d-9029-0529dd7de54c req-8568405e-8530-46ee-a5b9-922279c3b64f service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:53.294499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-51ef9637-a3ae-4c3d-9029-0529dd7de54c req-8568405e-8530-46ee-a5b9-922279c3b64f service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:53.327641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9e012dfc-d7e3-4a17-8301-b8f882478a54 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469505 Jul 19 12:32:53.329074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 126/252] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:32:53.356441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-51ef9637-a3ae-4c3d-9029-0529dd7de54c req-8568405e-8530-46ee-a5b9-922279c3b64f service nova] Creating event network-vif-deleted:f203350e-def1-416d-b638-aa74eaad8178 for instance 08bd0b37-9e8d-42ee-a74d-66cb79522e96 on hv-cinder-82099 Jul 19 12:32:53.361244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-70664c16-72a3-4c72-b6f3-8d8f5a0f31a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:53.362261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-70664c16-72a3-4c72-b6f3-8d8f5a0f31a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:53.377141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-51ef9637-a3ae-4c3d-9029-0529dd7de54c req-8568405e-8530-46ee-a5b9-922279c3b64f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113521 Jul 19 12:32:53.378156 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 127/253] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:53.458794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:53.459428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:53.479907 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:53.480900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:53.481319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:53.481763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:53.549812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:53.630758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-70664c16-72a3-4c72-b6f3-8d8f5a0f31a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:53.641792 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-70664c16-72a3-4c72-b6f3-8d8f5a0f31a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1218 microversion: 2.1 time: 0.290030 Jul 19 12:32:53.646401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 127/254] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:53 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:53.754373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:53.767757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c8cc0bbb-2bcf-4c78-8a3a-369e541fb748 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1273 microversion: 2.1 time: 0.312873 Jul 19 12:32:53.772484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 128/255] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:53 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:54.006917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:54.008223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:54.022433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:54.022954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:54.023759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:54.024252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:54.069603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lazy-loading 'flavor' on Instance uuid 91b29d50-f252-4413-b2aa-cdfcca1abd76 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:32:54.276840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:54.277975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:54.288329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:54.289051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:54.291824 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:54.294083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:54.406233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dadd1e92-d255-49d6-8cde-7a64aedbf1b9 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76/action" status: 200 len: 32 microversion: 2.1 time: 0.403498 Jul 19 12:32:54.425470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 128/256] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 12:32:54 2022] POST /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 12:32:54.445894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:54.450692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:54.479886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:54.480376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:54.488055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:54.490657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:55.071624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:55.085069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c6ffc241-1ea8-4f7e-9a14-6b4698ac2ab1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 0.814468 Jul 19 12:32:55.101900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 129/257] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:55.112517 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:55.113137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:55.134288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:55.135070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:55.135497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:55.135932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:55.268501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:55.280858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-78a940c7-b5f6-495f-ad53-8c3da4251235 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1270 microversion: 2.1 time: 0.177768 Jul 19 12:32:55.281830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 130/258] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:55 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:55.287269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:55.288118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:55.288282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:55.295242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:55.296439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:55.297596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:55.298249 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:55.302804 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-735425d4-f2c5-4726-9865-7c820c51641e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.873781 Jul 19 12:32:55.304195 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 129/259] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:54 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:55.385349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:55.399246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3161bf6d-77fe-4c2e-aca9-a8d688b5d30f tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1271 microversion: 2.1 time: 0.115780 Jul 19 12:32:55.400133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 131/260] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:55 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:56.106660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:56.107350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:56.120831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.124065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.127264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.129782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.297879 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:56.299093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:56.310254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.310719 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.311560 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.312002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.312890 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:56.322920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-71347b60-8dc9-4f8b-ab9f-3d5f53c5518f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 0.222651 Jul 19 12:32:56.333825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 130/261] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:56.349855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:56.350674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:56.360906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.361413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.362437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.363103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.478483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:56.486617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9c0bced3-da9e-4402-9d38-fc6161225273 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1270 microversion: 2.1 time: 0.192416 Jul 19 12:32:56.487565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 132/262] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:56 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:32:56.500933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:56.501933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:56.519471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.519963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.520857 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:56.521526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:56.752915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:56.762182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a81b4306-a574-4bff-8398-aefc78350219 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.426616 Jul 19 12:32:56.766013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 131/263] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:56 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:56.802438 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:56.816394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ac3b1b24-d8f6-41b8-9bad-fbc5715c98e8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.327602 Jul 19 12:32:56.826506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 133/264] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:56 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:57.347418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:57.348852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:57.364286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:57.364840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:57.366379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:57.367693 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:57.504001 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:57.504768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:57.515225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:57.515691 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:57.516635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:57.516957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:57.848453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:57.860604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-245cddd2-dfb1-4003-b560-0e88ac68a858 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1270 microversion: 2.1 time: 0.360651 Jul 19 12:32:57.871684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 134/265] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:57 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1270 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:57.879296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:57.880400 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:57.890141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:57.891198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:57.892226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:57.900784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:58.730329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:58.735434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:58.744580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad6d4d9a-ebe5-4c0d-ae2f-0cbc9b7a0131 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 1.408968 Jul 19 12:32:58.750420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 132/266] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:58.763474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:58.765572 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:58.785537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:58.786422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:58.791569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:58.792245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:59.022568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:59.040613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7eb24fdc-ad9b-4161-95b3-8a5efda6eac0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 1.167500 Jul 19 12:32:59.041395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 135/267] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:57 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:59.046297 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:59.047114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:59.054855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:59.055541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:59.056567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:59.057156 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:59.228542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:59.248104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-200e0395-44cc-4c37-88c9-f4c141d58a67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1276 microversion: 2.1 time: 0.205027 Jul 19 12:32:59.251426 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 136/268] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:59 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:59.257234 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-425183d3-667e-480f-a825-536ca18cec77 req-6bc951d0-e62b-46fa-9365-89a0ddeffc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3", "name": "network-vif-plugged", "status": "completed", "tag": "802e451a-2b49-4a6e-a7e6-80c9853cd706"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:59.269994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-425183d3-667e-480f-a825-536ca18cec77 req-6bc951d0-e62b-46fa-9365-89a0ddeffc92 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:59.270919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-425183d3-667e-480f-a825-536ca18cec77 req-6bc951d0-e62b-46fa-9365-89a0ddeffc92 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:59.294571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-425183d3-667e-480f-a825-536ca18cec77 req-6bc951d0-e62b-46fa-9365-89a0ddeffc92 service nova] Creating event network-vif-plugged:802e451a-2b49-4a6e-a7e6-80c9853cd706 for instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 on hv-cinder-82099 Jul 19 12:32:59.302662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-425183d3-667e-480f-a825-536ca18cec77 req-6bc951d0-e62b-46fa-9365-89a0ddeffc92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049966 Jul 19 12:32:59.304057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 137/269] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:59.312150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-11fab466-a4e1-46b2-822c-ecd7d7cfa123 req-ee5bcd7f-4991-4d69-8102-6cdcbd80a8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a4677a-52a4-490b-a217-1bb6de03bbbf", "tag": "e74a8cc9-6983-444e-b359-65125c015959"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:32:59.336216 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-11fab466-a4e1-46b2-822c-ecd7d7cfa123 req-ee5bcd7f-4991-4d69-8102-6cdcbd80a8d7 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:59.339161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-11fab466-a4e1-46b2-822c-ecd7d7cfa123 req-ee5bcd7f-4991-4d69-8102-6cdcbd80a8d7 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:59.373678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:32:59.383599 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6cbb491f-e656-4e7f-b63c-aa515592c5da tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.629897 Jul 19 12:32:59.384523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-11fab466-a4e1-46b2-822c-ecd7d7cfa123 req-ee5bcd7f-4991-4d69-8102-6cdcbd80a8d7 service nova] Creating event network-changed:e74a8cc9-6983-444e-b359-65125c015959 for instance 23a4677a-52a4-490b-a217-1bb6de03bbbf on hv-cinder-82099 Jul 19 12:32:59.388495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 133/270] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:58 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:32:59.395604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-11fab466-a4e1-46b2-822c-ecd7d7cfa123 req-ee5bcd7f-4991-4d69-8102-6cdcbd80a8d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089910 Jul 19 12:32:59.399077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 138/271] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:32:59.766690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:32:59.767793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:32:59.776060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:59.780660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:32:59.781738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:32:59.782892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:00.058445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:00.059160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:00.066774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:00.067226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:00.067995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:00.068874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:00.326435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:00.346548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-69ba91e7-4958-4447-9c35-d1c4412114c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 0.584001 Jul 19 12:33:00.347124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 134/272] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:32:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:00.361764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:00.362795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:00.369983 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:00.370905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:00.371661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:00.372242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:00.582952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:00.601171 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3485e66c-5d43-46bf-b3d9-67cc0efc8084 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.546786 Jul 19 12:33:00.603587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 139/273] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:00 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:00.610205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:00.611201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:00.619058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:00.619617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:00.620631 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:00.621888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:01.027262 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:01.039138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf60b90a-30b9-4997-bb67-d3dc2cba7cec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.680201 Jul 19 12:33:01.040617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 135/274] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:00 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:01.100094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:01.111232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8c9b3464-f68e-45f9-a9bd-2ebf599016f5 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.506134 Jul 19 12:33:01.114399 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 140/275] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:00 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:01.366352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:01.369557 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:01.381687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:01.382935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:01.385348 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:01.387304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:01.618949 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:01.619813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:01.632543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:01.633004 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:01.633789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:01.635417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:01.996939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:02.005624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-585d2b79-4c72-449d-83ff-081bafe768b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1364 microversion: 2.1 time: 0.645470 Jul 19 12:33:02.006202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 136/276] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1364 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:02.057552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:02.058236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:02.071137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:02.071901 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:02.072956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:02.088419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:02.406666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:02.422311 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c68fb400-ba11-4d9b-b15f-286d54178578 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.807074 Jul 19 12:33:02.427585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 141/277] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:01 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:02.441901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:02.449216 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:02.476194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:02.478125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:02.480604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:02.481436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:02.483298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:02.484008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:02.870608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:02.882986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ff4facac-8257-4cd5-b819-fb121744bfc8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.829396 Jul 19 12:33:02.884523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 137/278] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:02 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:03.024736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:03.026568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:03.036513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.037354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.048220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.049027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.073799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:03.089818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0e18a7ee-d29a-4e08-840d-5087f52a29eb tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.655138 Jul 19 12:33:03.090977 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 142/279] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:02 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:03.190813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:03.447000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:03.447770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:03.456621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.458207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.459869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.460509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.534512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:03.543561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4f132f27-20b2-4fd6-8393-8c9d4d0328c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1554 microversion: 2.1 time: 0.524451 Jul 19 12:33:03.556375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 138/280] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1554 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:03.563648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-105cdc4d-e536-44e9-919d-a9d42a3f98b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:03.565138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-105cdc4d-e536-44e9-919d-a9d42a3f98b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:03.573038 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-105cdc4d-e536-44e9-919d-a9d42a3f98b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.573739 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-105cdc4d-e536-44e9-919d-a9d42a3f98b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.574928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-105cdc4d-e536-44e9-919d-a9d42a3f98b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.575748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-105cdc4d-e536-44e9-919d-a9d42a3f98b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.636893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=14 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:03.715679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:03.728252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-105cdc4d-e536-44e9-919d-a9d42a3f98b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170425 Jul 19 12:33:03.728859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 139/281] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jul 19 12:33:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:03.731955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3dcae34b-9881-4093-ba71-739bcb65dd37 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.289134 Jul 19 12:33:03.741454 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 143/282] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:03 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:03.901827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:03.902928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:03.917216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.920548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.922594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:03.926427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:03.987406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-4f0c60ca-0cbb-44c9-880d-49b81e1a886e req-67c109d7-68d7-4ff1-b1dd-eaca8e2746af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cadeb57a-3504-4bac-86e9-e8ef951da265", "tag": "51c9b6a8-1f48-4884-9961-b7202894f711"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:04.011980 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-4f0c60ca-0cbb-44c9-880d-49b81e1a886e req-67c109d7-68d7-4ff1-b1dd-eaca8e2746af service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:04.023899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-4f0c60ca-0cbb-44c9-880d-49b81e1a886e req-67c109d7-68d7-4ff1-b1dd-eaca8e2746af service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:04.061600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-4f0c60ca-0cbb-44c9-880d-49b81e1a886e req-67c109d7-68d7-4ff1-b1dd-eaca8e2746af service nova] Creating event network-changed:51c9b6a8-1f48-4884-9961-b7202894f711 for instance cadeb57a-3504-4bac-86e9-e8ef951da265 on hv-cinder-82099 Jul 19 12:33:04.068943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-4f0c60ca-0cbb-44c9-880d-49b81e1a886e req-67c109d7-68d7-4ff1-b1dd-eaca8e2746af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098793 Jul 19 12:33:04.070017 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 144/283] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:04.107798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:04.109173 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:04.117850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:04.118576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:04.119784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:04.120539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:04.787097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:04.797202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b964e7de-d7c8-494f-bf94-c217845fcceb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.900419 Jul 19 12:33:04.798751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 140/284] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:03 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:04.814767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-217b9a75-14ea-4425-9563-91d4ef86ba7b req-6e93fc02-0985-4e45-bfe1-502139b8c598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a4677a-52a4-490b-a217-1bb6de03bbbf", "name": "network-vif-plugged", "status": "completed", "tag": "e74a8cc9-6983-444e-b359-65125c015959"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:04.837186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-217b9a75-14ea-4425-9563-91d4ef86ba7b req-6e93fc02-0985-4e45-bfe1-502139b8c598 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:04.842909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-217b9a75-14ea-4425-9563-91d4ef86ba7b req-6e93fc02-0985-4e45-bfe1-502139b8c598 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:04.877704 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-217b9a75-14ea-4425-9563-91d4ef86ba7b req-6e93fc02-0985-4e45-bfe1-502139b8c598 service nova] Creating event network-vif-plugged:e74a8cc9-6983-444e-b359-65125c015959 for instance 23a4677a-52a4-490b-a217-1bb6de03bbbf on hv-cinder-82099 Jul 19 12:33:04.894391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-217b9a75-14ea-4425-9563-91d4ef86ba7b req-6e93fc02-0985-4e45-bfe1-502139b8c598 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092581 Jul 19 12:33:04.899324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 141/285] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:04.901548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:04.911937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:04.912857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:04.925642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cea08f11-a1f1-46ac-8167-d1920f5fa46d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.822403 Jul 19 12:33:04.931192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:04.933375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 145/286] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:04 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:04.933797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:04.938631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:04.939860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:05.377025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:05.392750 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da344ac7-6d74-4beb-9a39-feb1e4b3c33f tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.488941 Jul 19 12:33:05.393508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 142/287] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:04 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:05.814546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:05.815164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:05.834656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:05.835402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:05.836569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:05.837374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:05.951332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:05.951973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:05.962488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:05.963061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:05.963915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:05.964613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:06.156278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:06.175546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-61d339ad-cd01-4712-8637-2226e7e298b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.365481 Jul 19 12:33:06.176917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 146/288] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:05 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:06.411074 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:06.411995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:06.427864 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:06.429878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:06.431543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:06.438945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:06.452325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:06.578718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:06.586803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e65b2b0-4ed9-4ca7-8f31-72e14c28ee98 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.643980 Jul 19 12:33:06.593978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 143/289] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:05 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:06.708874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:06.723789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7af810dc-5cb3-4f8d-ac2a-1c682d367ec4 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.314901 Jul 19 12:33:06.723789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 147/290] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:06 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:06.745824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-042fedce-206e-4ce0-9580-6c2e05157db4 req-29951da2-5632-43a7-b02e-d483d6730ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3", "tag": "802e451a-2b49-4a6e-a7e6-80c9853cd706"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:06.754668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-042fedce-206e-4ce0-9580-6c2e05157db4 req-29951da2-5632-43a7-b02e-d483d6730ae2 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:06.755125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-042fedce-206e-4ce0-9580-6c2e05157db4 req-29951da2-5632-43a7-b02e-d483d6730ae2 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:06.767409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-042fedce-206e-4ce0-9580-6c2e05157db4 req-29951da2-5632-43a7-b02e-d483d6730ae2 service nova] Creating event network-changed:802e451a-2b49-4a6e-a7e6-80c9853cd706 for instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 on hv-cinder-82099 Jul 19 12:33:06.773785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-042fedce-206e-4ce0-9580-6c2e05157db4 req-29951da2-5632-43a7-b02e-d483d6730ae2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031385 Jul 19 12:33:06.774974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 144/291] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:07.195270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:07.195888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:07.203900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:07.204392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:07.205170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:07.205603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:07.515602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:07.528422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-64de3f10-03d8-4b88-bb09-ccd602dc329f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.338950 Jul 19 12:33:07.529005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 148/292] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:07 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:07.611741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:07.613673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:07.632025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:07.633299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:07.634159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:07.635016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:07.738516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:07.739134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:07.755598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:07.763170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:07.767150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:07.768833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:08.159256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:08.169364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-793bcdd5-ff56-4f43-a8a2-3e1a58692acc tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.562887 Jul 19 12:33:08.171228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 145/293] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:07 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:08.241643 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:08.265355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ac24b7ae-8f71-41c5-bdcf-5e37da6405cd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.527642 Jul 19 12:33:08.266342 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 149/294] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:07 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:08.549417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:08.550042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:08.559707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:08.560230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:08.563595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:08.564071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:08.905393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:08.918232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-115eb0db-c47a-41c0-aaac-60020d1b2877 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.375635 Jul 19 12:33:08.920980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 146/295] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:08 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:09.188133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:09.188780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:09.198122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:09.198577 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:09.199386 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:09.199808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:09.286053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:09.286673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:09.294151 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:09.302294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:09.303871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:09.304426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:09.784742 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:09.789505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:09.797520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-39e4b100-ac86-46e6-bbaf-4fad557be837 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.518322 Jul 19 12:33:09.798104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 147/296] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:09 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:09.804390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-776682b3-4741-43c7-a0cb-3b88a54ec75c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.616195 Jul 19 12:33:09.804390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 150/297] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:09 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:09.937324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:09.938243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:09.944432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:09.944892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:09.945668 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:09.946105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:10.094943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:10.102859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ee5804b5-ec21-4344-a3cb-3584c9c8bd3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.169943 Jul 19 12:33:10.103435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 151/298] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:09 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:10.816983 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:10.817575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:10.818180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:10.819324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:10.833741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:10.834609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:10.834896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:10.835457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:10.836129 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:10.836959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:10.839982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:10.840759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:11.118136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:11.134020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:11.142412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1cbcbcc1-7126-4b54-b09a-96615ea58436 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.329558 Jul 19 12:33:11.144047 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 148/299] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:10 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:11.164078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b4aa342a-14d5-435a-9905-04778a0e51db tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.350684 Jul 19 12:33:11.166254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:11.168802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:11.169399 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 152/300] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:10 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:11.176766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:11.177222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:11.179709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:11.180154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:11.363599 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:11.371875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c43c1ca5-a13b-418a-8dcd-95d02d6d51b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.212081 Jul 19 12:33:11.372475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 149/301] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:11 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:11.875966 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0c10f61c-8a1c-4ff5-8b9d-ac08343c7bc0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Action: 'create', calling method: .version_select at 0x7fd9943ce5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2096215092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1BEDN5MHMZLkKoDwHdXMV6xrHDyFdSCs9sLfxYaG7TdBBX5JwFOiMEP2FGlKboZA7p1DeHM6joRQ0x2/gS3/snjlKbftxl1SgIABgj9EqRBQNQ06G8Tl8sMVBfJCwdpg=="}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:11.890148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-0c10f61c-8a1c-4ff5-8b9d-ac08343c7bc0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Getting quotas for project b4a603ce9a934f188a137ee171d66aa7. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:33:11.893636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-0c10f61c-8a1c-4ff5-8b9d-ac08343c7bc0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Getting quotas for user 880c0417a58d48ceaab3912957f2e4a7 and project b4a603ce9a934f188a137ee171d66aa7. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:33:11.916277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0c10f61c-8a1c-4ff5-8b9d-ac08343c7bc0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.217229 Jul 19 12:33:11.917174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 153/302] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 12:33:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:12.161430 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:12.162025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:12.169562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:12.170067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:12.170897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:12.171332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:12.181793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:12.182460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:12.189558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:12.190329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:12.191883 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:12.192700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:12.470096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:12.474802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:12.481053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a5f9732-902b-4ee2-9d8a-f511309e8f21 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.323434 Jul 19 12:33:12.482236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e08a5b92-8289-412f-a04c-4c109b401084 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1313 microversion: 2.1 time: 0.304965 Jul 19 12:33:12.482882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 150/303] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:12 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:12.484656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 154/304] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:12 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:12.488677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:12.492833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:12.504561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:12.505379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:12.506315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:12.506955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:12.512235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:12.728482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:12.741497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-466750fa-8e22-4ccf-a973-79091e46fa00 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.257276 Jul 19 12:33:12.745422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 151/305] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:12 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:13.509012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:13.510299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:13.511907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:13.512494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:13.523573 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:13.527444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:13.528248 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:13.528770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:13.530625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:13.531579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:13.532077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:13.532640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:13.950640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:13.959361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4d5e3998-9982-4a12-948a-37ee2360c76d tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1497 microversion: 2.1 time: 0.462518 Jul 19 12:33:13.972276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 152/306] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:13 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1497 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:13.984119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:13.998630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1871a8d9-ea32-43f0-9126-5d45cf3cc38b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.499520 Jul 19 12:33:14.001353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:14.008091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:14.020882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 155/307] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:13 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:14.028891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:14.029898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:14.031092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:14.031542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:14.346398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:14.373880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c69ecd96-16a5-4c0b-b919-de69cfd5089f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.405984 Jul 19 12:33:14.378698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 153/308] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:13 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:14.506397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-1922ea91-b0df-421e-8ea3-97cbee613208 req-2819f543-ffa2-488f-839e-69bedb267eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadeb57a-3504-4bac-86e9-e8ef951da265", "name": "network-vif-plugged", "status": "completed", "tag": "51c9b6a8-1f48-4884-9961-b7202894f711"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:14.522842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-1922ea91-b0df-421e-8ea3-97cbee613208 req-2819f543-ffa2-488f-839e-69bedb267eb8 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:14.523989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-1922ea91-b0df-421e-8ea3-97cbee613208 req-2819f543-ffa2-488f-839e-69bedb267eb8 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:14.552429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-1922ea91-b0df-421e-8ea3-97cbee613208 req-2819f543-ffa2-488f-839e-69bedb267eb8 service nova] Creating event network-vif-plugged:51c9b6a8-1f48-4884-9961-b7202894f711 for instance cadeb57a-3504-4bac-86e9-e8ef951da265 on hv-cinder-82099 Jul 19 12:33:14.572697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-1922ea91-b0df-421e-8ea3-97cbee613208 req-2819f543-ffa2-488f-839e-69bedb267eb8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068542 Jul 19 12:33:14.575494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 156/309] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:14.836116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:14.836808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:14.849839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:14.850656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:14.852940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:14.854582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:14.943370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:33:15.036714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:15.038230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:15.049071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:15.049936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:15.051363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:15.054754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:15.151938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc7a2475-0c1f-45cf-bafb-590e09505be8 tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 204 len: 0 microversion: 2.1 time: 0.320106 Jul 19 12:33:15.157527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 154/310] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:33:14 2022] DELETE /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:33:15.166225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:15.167947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:15.180486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:15.181110 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:15.182209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:15.182941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:15.391686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:15.402550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-796fba98-7305-40da-a744-0aaa57653f82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.379111 Jul 19 12:33:15.415712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 157/311] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:15 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:15.420628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:15.421466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:15.428205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:15.428894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:15.429943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:15.430528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:15.476803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:15.486730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8ec3789-66bf-48d9-86a6-3858358e89ce tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1503 microversion: 2.1 time: 0.326690 Jul 19 12:33:15.487227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 155/312] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:15 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:15.649170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:15.661083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-313e3647-801b-4704-ba34-e167a2e4b546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.243457 Jul 19 12:33:15.672829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 158/313] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:15 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:16.421608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:16.422221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:16.434982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:16.435469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:16.436267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:16.436705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:16.515525 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:16.516313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:16.537952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:16.549978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:16.550848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:16.551334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:16.777067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:16.792747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a18302b2-516f-428d-8d31-0cf605ddae28 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.375066 Jul 19 12:33:16.794169 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 156/314] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:16 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:16.811705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:16.813977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:16.831144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:16.835238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:16.837143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:16.839803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:17.176641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:17.185913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8a8b7f5-2788-438c-a86c-f053319ad787 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1318 microversion: 2.1 time: 0.384442 Jul 19 12:33:17.193416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 157/315] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:16 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:17.233499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:17.245447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b9557381-77fa-4d69-aae9-33bb25e5132e tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1503 microversion: 2.1 time: 0.745872 Jul 19 12:33:17.248744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 159/316] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:16 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1503 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:17.812297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:17.812989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:17.825026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:17.826401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:17.827376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:17.828315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:18.015873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:18.024031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ff6f2197-e252-45ad-8372-1b94412eaea0 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.217697 Jul 19 12:33:18.024670 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 158/317] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:17 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:18.210160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:18.210768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:18.222552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:18.222994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:18.223773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:18.224228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:18.265420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:18.266078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:18.278736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:18.279610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:18.284094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:18.284784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:18.639496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:18.647599 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c8ffb42f-047c-49d5-a27e-05e7c9a623de tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1503 microversion: 2.1 time: 0.387045 Jul 19 12:33:18.649072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 159/318] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:18 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:18.650287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:18.661091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-53542800-5570-41ea-9d95-7d5c94e13be8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1507 microversion: 2.1 time: 0.455303 Jul 19 12:33:18.661938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 160/319] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:18 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:19.047126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:19.049360 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:19.057669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:19.057802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-86768800-94d8-47d9-b104-8432f0ba4d3b req-a7a1b720-fe39-4150-b8fb-00f6d4b54b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a4677a-52a4-490b-a217-1bb6de03bbbf", "name": "network-vif-deleted", "tag": "e74a8cc9-6983-444e-b359-65125c015959"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:19.058441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:19.059454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:19.059970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:19.076223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-86768800-94d8-47d9-b104-8432f0ba4d3b req-a7a1b720-fe39-4150-b8fb-00f6d4b54b07 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:19.076687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-86768800-94d8-47d9-b104-8432f0ba4d3b req-a7a1b720-fe39-4150-b8fb-00f6d4b54b07 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:19.097971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-86768800-94d8-47d9-b104-8432f0ba4d3b req-a7a1b720-fe39-4150-b8fb-00f6d4b54b07 service nova] Creating event network-vif-deleted:e74a8cc9-6983-444e-b359-65125c015959 for instance 23a4677a-52a4-490b-a217-1bb6de03bbbf on hv-cinder-82099 Jul 19 12:33:19.107362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-86768800-94d8-47d9-b104-8432f0ba4d3b req-a7a1b720-fe39-4150-b8fb-00f6d4b54b07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053002 Jul 19 12:33:19.110201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 161/320] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:33:19.289209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:19.317216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-63b19a05-4f35-4f94-bb71-600db6435014 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.279744 Jul 19 12:33:19.321071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 160/321] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:19 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:19.674227 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:19.675034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:19.683006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:19.683663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:19.685217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:19.685662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:19.733101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:19.733552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:19.734010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lazy-loading 'fault' on Instance uuid 23a4677a-52a4-490b-a217-1bb6de03bbbf {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:33:19.796731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f832895e13784dfaa69b44505da8855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5a1bf2e2af4328ab3f1b68b4160b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:19.809277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2ec60475-e870-42c2-b283-a29759f79cac tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 200 len: 1303 microversion: 2.1 time: 0.146484 Jul 19 12:33:19.812099 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 162/322] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:19 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:20.339807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:20.340411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:20.347143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:20.347536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:20.348335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:20.348775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:20.516666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:20.524703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7a1b3af4-224a-4667-9947-ca04a45874b1 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.189535 Jul 19 12:33:20.526083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 161/323] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:20 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:20.828415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:20.829088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] [instance: 23a4677a-52a4-490b-a217-1bb6de03bbbf] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:20.835686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:20.835851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:20.836522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:20.837356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:20.851581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] HTTP exception thrown: Instance 23a4677a-52a4-490b-a217-1bb6de03bbbf could not be found. Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Request method failure captured: Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf HTTP/1.1 Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qROfA2_wRXLb1krnvIDSIJInPgJyMwPYSKR35Qmg11w85jdJy9Pgw79pZVVPOzvJQmTeFiaGqAL8Pm1ERdkJPTaS8T3bmfd4oWK2nyaMArCZrng5cKPBMuDgJ0gvvUp_lGJ_9p8DhAwgU74bBb4e-OrPMyqSPEEF-jFmlBszcj5PAQ Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 7c5a1bf2e2af4328ab3f1b68b4160b7b Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesActionsTest-1694135667 Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:33:20.853271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c5a1bf2e2af4328ab3f1b68b4160b7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c5a1bf2e2af4328ab3f1b68b4160b7b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c5a1bf2e2af4328ab3f1b68b4160b7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c5a1bf2e2af4328ab3f1b68b4160b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesActionsTest-1694135667 Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 7c5a1bf2e2af4328ab3f1b68b4160b7b Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesActionsTest-1694135667 Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesActionsTest-1694135667-project Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: f832895e13784dfaa69b44505da8855b Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesActionsTest-1694135667-project Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 23a4677a-52a4-490b-a217-1bb6de03bbbf could not be found. Jul 19 12:33:20.854595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '23a4677a-52a4-490b-a217-1bb6de03bbbf'} Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a4677a-52a4-490b-a217-1bb6de03bbbf could not be found. Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:33:20.855359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a4677a-52a4-490b-a217-1bb6de03bbbf could not be found. Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a4677a-52a4-490b-a217-1bb6de03bbbf could not be found. Jul 19 12:33:20.857698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:33:20.858710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] Returning 404 to user: Instance 23a4677a-52a4-490b-a217-1bb6de03bbbf could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:33:20.858710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c814f56e-3640-43c1-a9b5-29a77ee1910c tempest-VolumesActionsTest-1694135667 tempest-VolumesActionsTest-1694135667-project] 10.222.0.13 "GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf" status: 404 len: 111 microversion: 2.1 time: 0.030166 Jul 19 12:33:20.858710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 163/324] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:20 2022] GET /compute/v2.1/servers/23a4677a-52a4-490b-a217-1bb6de03bbbf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:33:21.541385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:21.541933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:21.550214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:21.550660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:21.551428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:21.551865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:21.711004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:21.720227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3329d59d-7794-4387-b938-93604f44ac93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.182617 Jul 19 12:33:21.720991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:21 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:22.737188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:22.737783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:22.739726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:22.745273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:22.745727 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:22.746486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:22.746925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:22.876752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:22.884889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b87930b2-4cc8-4c3c-9370-faefa98d98fc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1501 microversion: 2.1 time: 0.151497 Jul 19 12:33:22.885465 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 164/326] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:22 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:22.900933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e489d022-5164-4ecc-b5fe-14624cee60bb"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:22.902076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:22.909224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:22.909677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:22.910443 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:22.910886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:22.934396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] HTTP exception thrown: Cannot 'attach_volume' instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 while it is in vm_state rescued Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Request method failure captured: Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: POST /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76/os-volume_attachments HTTP/1.1 Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 74 Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQOxsCk87izCeam6W8Y9KH8-hgnipPqGe_jLWuW7RWKjvkAqy-GskVE1KyYrSq8MmheGg4ODGWfp1Wp3HljkBwqH80TSvp7-jBt6wU1dIkqzIS9MdgICP6HPLe5J8XY1hpl-aNPxZFQzIKXwdGlFh1IpWvzSXgBi5-x0SdtFSMrmtM Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:33:22.936158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12a3207b8cea465d8d1ed5c9e3963a4f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 62766e7afd01401293df7e08707d6d95 Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {"volumeAttachment": {"volumeId": "e489d022-5164-4ecc-b5fe-14624cee60bb"}} Jul 19 12:33:22.937737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Cannot 'attach_volume' instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 while it is in vm_state rescued Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'server_id': '91b29d50-f252-4413-b2aa-cdfcca1abd76', 'body': {'volumeAttachment': {'volumeId': 'e489d022-5164-4ecc-b5fe-14624cee60bb'}}} Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:33:22.938764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 while it is in vm_state rescued Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:33:22.940154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:33:22.941877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:33:22.941877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:33:22.941877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 while it is in vm_state rescued Jul 19 12:33:22.941877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:33:22.941877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Returning 409 to user: Cannot 'attach_volume' instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 while it is in vm_state rescued {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:33:22.941877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97726437-0a5b-420a-88d6-af35ebb764e7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040711 Jul 19 12:33:22.941877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 163/327] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 12:33:22 2022] POST /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 12:33:22.946957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9fddb205-9fe6-4a00-85c8-5124fc175186 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:22.947514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9fddb205-9fe6-4a00-85c8-5124fc175186 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:22.953416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fddb205-9fe6-4a00-85c8-5124fc175186 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:22.953863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fddb205-9fe6-4a00-85c8-5124fc175186 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:22.954625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fddb205-9fe6-4a00-85c8-5124fc175186 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:22.955062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fddb205-9fe6-4a00-85c8-5124fc175186 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:23.006546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:23.034318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9fddb205-9fe6-4a00-85c8-5124fc175186 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76/action" status: 202 len: 0 microversion: 2.1 time: 0.090903 Jul 19 12:33:23.035441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 165/328] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 12:33:22 2022] POST /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 12:33:23.043633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:23.044332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:23.050996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:23.051452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:23.052261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:23.052695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:23.282167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:23.292873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5b556c8-c0a9-4edf-93f5-d0405a80ea14 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1509 microversion: 2.1 time: 0.252789 Jul 19 12:33:23.293754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 164/329] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:23 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:24.311524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:24.312143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:24.318385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:24.318836 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:24.319592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:24.320057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:24.459474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:24.467006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1e3dc4ea-24ed-4d79-b8ff-6a67d6a77d06 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1509 microversion: 2.1 time: 0.159815 Jul 19 12:33:24.467571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 166/330] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:24 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:25.485610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:25.486513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:25.489479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:25.495148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:25.495606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:25.496433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:25.496904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:25.655464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:25.663409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9f362445-63be-4601-8490-50dee96d74f7 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1509 microversion: 2.1 time: 0.183035 Jul 19 12:33:25.673780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 165/331] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:25 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:26.681798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:26.682529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:26.688891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:26.689368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:26.690546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:26.691032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:26.836245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:26.843738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6646ed0a-d588-41a2-8e73-c5f1387febbb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1515 microversion: 2.1 time: 0.166729 Jul 19 12:33:26.844611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 167/332] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:26 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:28.277798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db01514a-5aac-4cee-b2f4-bc534ecfc994 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'create', calling method: .version_select at 0x7fd9943e2310>, body: {"keypair": {"name": "tempest-keypair-790330851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5LttoFFglEx5dPFnUlK97zLe/mzOyaBs4R1zk2gUzHe0Mgn107Bz71x5MDhv3Ddknjwg8kwYQxTXeJ+v+SGVnnu2H/ZykvEKMzqSdiRI0aY/wnPac+N1aMYujw647chQ=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:28.297661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-db01514a-5aac-4cee-b2f4-bc534ecfc994 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:33:28.301607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-db01514a-5aac-4cee-b2f4-bc534ecfc994 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for user 62766e7afd01401293df7e08707d6d95 and project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:33:28.343800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db01514a-5aac-4cee-b2f4-bc534ecfc994 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069659 Jul 19 12:33:28.344238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 166/333] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 12:33:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:29.871962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2119824770", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af3e2e9d-40a0-4fc6-a69d-01cb00762ce4"}], "security_groups": [{"name": "tempest-securitygroup--1083649214"}], "key_name": "tempest-keypair-790330851", "user_data": "}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:31.370657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] validate_networks() for [('af3e2e9d-40a0-4fc6-a69d-01cb00762ce4', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:33:31.783685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:33:31.784100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:33:31.784780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:33:31.785374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:33:31.785791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:33:31.800815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:31.800815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:31.800815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:31.800815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:31.815460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:33:31.819642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Getting quotas for user 62766e7afd01401293df7e08707d6d95 and project 12a3207b8cea465d8d1ed5c9e3963a4f. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:33:31.830814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:33:31.833076 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:33:31.877546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8dc1fa53-ff77-4c94-9879-b8fccee366ba tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.009791 Jul 19 12:33:31.878180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 168/334] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:33:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:33:31.888312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b47085e1-d783-4024-8f2e-9bdcc2d21cac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:31.889040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b47085e1-d783-4024-8f2e-9bdcc2d21cac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:31.950024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b47085e1-d783-4024-8f2e-9bdcc2d21cac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:31.957773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b47085e1-d783-4024-8f2e-9bdcc2d21cac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1245 microversion: 2.1 time: 0.073659 Jul 19 12:33:31.958768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 167/335] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:31 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:32.974578 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:32.975193 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:32.977235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:32.983368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:32.983809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:32.984609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:32.985050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:33.047141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:33.054450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-794d4d5e-fd9d-4e7f-a915-d94c3f189848 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1249 microversion: 2.1 time: 0.083711 Jul 19 12:33:33.055008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 169/336] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:32 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:34.071356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:34.071966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:34.078608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:34.079057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:34.079825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:34.080286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:34.097799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:34.143200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:34.150428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2e40bebd-31a0-457d-b674-9ca778f67aee tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1241 microversion: 2.1 time: 0.082878 Jul 19 12:33:34.150990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 168/337] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:34 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:35.167458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:35.168153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:35.174896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:35.175429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:35.176346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:35.176858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:35.252656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:35.261536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b3e59ba9-8c4a-457d-910d-93e71e2a3c82 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1305 microversion: 2.1 time: 0.097861 Jul 19 12:33:35.262193 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 170/338] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:35 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:36.279279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:36.279936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:36.286601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:36.287091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:36.287835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:36.288293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:36.506809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:36.514800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-85423db2-5aae-4d64-9a5c-1de8b6b5582b tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.240051 Jul 19 12:33:36.515458 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 169/339] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:36 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:36.637831 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-bb7659ef-b6e5-4ce3-8c64-b4ae8297c7a9 req-a332b35d-9d02-434e-89a5-d77f50f9f4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b74d78c-d928-44cd-8bed-3105d5055fed", "tag": "94eaf513-157f-4d2d-b4b9-db0f37900664"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:36.655919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-bb7659ef-b6e5-4ce3-8c64-b4ae8297c7a9 req-a332b35d-9d02-434e-89a5-d77f50f9f4c2 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:36.656642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-bb7659ef-b6e5-4ce3-8c64-b4ae8297c7a9 req-a332b35d-9d02-434e-89a5-d77f50f9f4c2 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:36.673246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-bb7659ef-b6e5-4ce3-8c64-b4ae8297c7a9 req-a332b35d-9d02-434e-89a5-d77f50f9f4c2 service nova] Creating event network-changed:94eaf513-157f-4d2d-b4b9-db0f37900664 for instance 6b74d78c-d928-44cd-8bed-3105d5055fed on hv-cinder-82099 Jul 19 12:33:36.678841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-bb7659ef-b6e5-4ce3-8c64-b4ae8297c7a9 req-a332b35d-9d02-434e-89a5-d77f50f9f4c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046275 Jul 19 12:33:36.679635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 171/340] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:37.533442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:37.534623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:37.541123 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:37.546492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:37.546492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:37.546492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:37.694402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:37.701709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40b70b4c-c883-4abb-a62f-fffec89fb7b5 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.172134 Jul 19 12:33:37.702274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 170/341] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:37 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:38.719189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:38.719871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:38.726070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:38.726521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:38.727276 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:38.727709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:38.860941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:38.869348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0844314a-29a5-4c90-b216-dabef1f9aa24 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.154170 Jul 19 12:33:38.869855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 172/342] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:38 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:39.886591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:39.887202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:39.894307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:39.894761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:39.895526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:39.895957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:40.027768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:40.036162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-53647267-8350-4a56-85d8-ff1aa5299e90 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.153300 Jul 19 12:33:40.036775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 171/343] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:39 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:41.053574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:41.054299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:41.061633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:41.062346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:41.063190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:41.063802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:41.206009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:41.214294 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-10b90054-c97f-4278-8298-ebdb7ca3a830 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.164577 Jul 19 12:33:41.214993 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 173/344] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:41 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:42.231714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:42.232369 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:42.234654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:42.240989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:42.241506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:42.242513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:42.242952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:42.400647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:42.410820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2b4feaca-bb1f-473c-802e-1fe87d26474a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.183552 Jul 19 12:33:42.412469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 172/345] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:42 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:43.431549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:43.432306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:43.434838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:43.435505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:43.442049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:43.442500 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:43.443264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:43.443726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:43.601988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:43.611059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-36fa0f1d-ac32-4a78-acce-af934409b93a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.182986 Jul 19 12:33:43.612894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 174/346] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:43 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:44.633279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:44.633985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:44.641254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:44.642004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:44.643016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:44.643715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:44.787774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:44.796881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ef782a7-e5c8-41b4-9ccf-9fa1cf08ba57 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.167975 Jul 19 12:33:44.797822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 173/347] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:44 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:45.814076 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:45.814996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:45.821162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:45.821621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:45.822459 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:45.822904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:45.970564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:45.978051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-65c64681-aaaa-4306-9658-e01da9fd340e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.167915 Jul 19 12:33:45.978634 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 175/348] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:45 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:46.995259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:46.995959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:47.003448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:47.003897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:47.004721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:47.005173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:47.145209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:47.154431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e702aae2-c460-40ee-b060-51870ef23a93 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.163319 Jul 19 12:33:47.155199 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 174/349] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:46 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:48.173825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:48.175197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:48.182224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:48.182991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:48.184019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:48.184653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:48.331952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:48.339944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-715de0ac-e4f6-441b-8673-6a846775ff87 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.171079 Jul 19 12:33:48.345698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 176/350] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:48 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:49.362775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:49.363409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:49.370010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:49.370470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:49.372028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:49.373178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:49.526525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:49.535537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-08268774-b83a-40b9-b860-9115250a9d22 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.176551 Jul 19 12:33:49.536283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 175/351] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:49 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:50.554373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:50.555071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:50.561416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:50.562160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:50.563152 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:50.563809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:50.718870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:50.726653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fd3ad3d0-ef56-4f11-82b4-17b40077352a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.176196 Jul 19 12:33:50.736446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 177/352] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:50 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:51.742954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:51.743570 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:51.750431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:51.750882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:51.751685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:51.752125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:51.880572 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:51.888307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-feebb0f1-8694-4b58-af88-cb6d40dd42e2 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.148626 Jul 19 12:33:51.888961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 176/353] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:51 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:52.906107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:52.907305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:52.914118 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:52.914921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:52.915976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:52.916472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:53.064242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:53.066395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:53.072763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c2da1607-9f27-4341-93b2-6ff1bfbf4dac tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.171479 Jul 19 12:33:53.073323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 178/354] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:52 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:33:54.089931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:54.091191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:54.097766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:54.098213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:54.099037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:54.099637 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:54.235852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:54.243595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19b195ab-ef40-4b88-b301-e22b5b6e76fe tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.157834 Jul 19 12:33:54.244695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 177/355] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:54 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:55.269354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:55.270173 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:55.284538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:55.286078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:55.289263 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:55.289961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:55.449436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:55.457397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3be673b6-6886-4862-a5dc-79dfba6f302a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.198984 Jul 19 12:33:55.467645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 179/356] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:55 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:56.477843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:56.479705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:56.483548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:56.487650 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:56.488068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:56.489060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:56.489500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:56.610720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-84ec3232-e495-401f-a921-11be5122704f req-b7683c6c-8fdd-4da6-8ef6-3e0a40389ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b74d78c-d928-44cd-8bed-3105d5055fed", "name": "network-vif-plugged", "status": "completed", "tag": "94eaf513-157f-4d2d-b4b9-db0f37900664"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:56.631258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-84ec3232-e495-401f-a921-11be5122704f req-b7683c6c-8fdd-4da6-8ef6-3e0a40389ccd service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:56.631903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-84ec3232-e495-401f-a921-11be5122704f req-b7683c6c-8fdd-4da6-8ef6-3e0a40389ccd service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:56.675108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-84ec3232-e495-401f-a921-11be5122704f req-b7683c6c-8fdd-4da6-8ef6-3e0a40389ccd service nova] Creating event network-vif-plugged:94eaf513-157f-4d2d-b4b9-db0f37900664 for instance 6b74d78c-d928-44cd-8bed-3105d5055fed on hv-cinder-82099 Jul 19 12:33:56.686648 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-84ec3232-e495-401f-a921-11be5122704f req-b7683c6c-8fdd-4da6-8ef6-3e0a40389ccd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079709 Jul 19 12:33:56.687544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:56.691545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 180/357] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:33:56.695944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2167416-d0a8-43ef-af96-5cb7c2222775 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.224449 Jul 19 12:33:56.706410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 178/358] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:56 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:57.716393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:57.717378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:57.731968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:57.732690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:57.733658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:57.734266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:57.912908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:57.928670 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-eff7d40d-441d-47ea-bb01-8831840ce966 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.218736 Jul 19 12:33:57.929347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 181/359] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:57 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:58.951504 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:33:58.953359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:33:58.963384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:58.964083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:58.966450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:58.967620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:59.121362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-88746404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2096215092", "security_groups": [{"name": "tempest-secgroup-smoke-1221233297"}], "block_device_mapping_v2": [{"uuid": "155f00c5-1e38-4c90-9a8f-478a8391af97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "98ecbcc9-a925-446b-a0cf-913d181fba45"}]}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:33:59.195352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:33:59.210976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b1dfc6eb-dc67-4ee4-843d-a80983fb4fae tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1371 microversion: 2.1 time: 0.268132 Jul 19 12:33:59.224759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 179/360] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:33:58 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:33:59.272850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] validate_networks() for [('98ecbcc9-a925-446b-a0cf-913d181fba45', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:33:59.924977 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:33:59.925464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:33:59.925941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:33:59.926351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:33:59.926799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:33:59.936503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:59.936964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:59.937780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:33:59.938218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:33:59.955999 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Getting quotas for project b4a603ce9a934f188a137ee171d66aa7. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:33:59.960146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Getting quotas for user 880c0417a58d48ceaab3912957f2e4a7 and project b4a603ce9a934f188a137ee171d66aa7. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:34:00.041778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:34:00.043921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='155f00c5-1e38-4c90-9a8f-478a8391af97',volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:34:00.193945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9bb5764a-c6c9-43f9-a143-4be22ed781c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.076243 Jul 19 12:34:00.195269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 182/361] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:33:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 12:34:00.206316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf4a83ad-91a2-40f5-b91a-08ae04993415 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:00.207568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf4a83ad-91a2-40f5-b91a-08ae04993415 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:00.228275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:00.228899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:00.264605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:00.265308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:00.266097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:00.266540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:00.306072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf4a83ad-91a2-40f5-b91a-08ae04993415 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:00.314064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf4a83ad-91a2-40f5-b91a-08ae04993415 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1093 microversion: 2.1 time: 0.110975 Jul 19 12:34:00.314858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 180/362] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:00 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1093 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:34:00.470358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:00.479938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9c4329c5-1d5d-4216-8c7d-41ee1af5736a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1565 microversion: 2.1 time: 0.255579 Jul 19 12:34:00.480916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 183/363] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:00 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:34:00.497672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e5f82890-fa57-461c-a5cd-0d15fa36fc7e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:00.498344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e5f82890-fa57-461c-a5cd-0d15fa36fc7e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:00.504965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5f82890-fa57-461c-a5cd-0d15fa36fc7e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:00.505553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5f82890-fa57-461c-a5cd-0d15fa36fc7e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:00.506364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5f82890-fa57-461c-a5cd-0d15fa36fc7e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:00.506991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5f82890-fa57-461c-a5cd-0d15fa36fc7e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:00.598480 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e5f82890-fa57-461c-a5cd-0d15fa36fc7e tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105468 Jul 19 12:34:00.599209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 181/364] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jul 19 12:34:00 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:34:01.133031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2d6911c0-8864-43e5-bf91-35bc26f2bf2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:01.133701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2d6911c0-8864-43e5-bf91-35bc26f2bf2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:01.141194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d6911c0-8864-43e5-bf91-35bc26f2bf2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:01.141748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d6911c0-8864-43e5-bf91-35bc26f2bf2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:01.142613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d6911c0-8864-43e5-bf91-35bc26f2bf2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:01.143135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d6911c0-8864-43e5-bf91-35bc26f2bf2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:01.170379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2d6911c0-8864-43e5-bf91-35bc26f2bf2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/ips" status: 200 len: 149 microversion: 2.1 time: 0.041853 Jul 19 12:34:01.171385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 184/365] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:34:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:34:01.339145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:01.339780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:01.376520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:01.376520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:01.378093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:01.385306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:01.602513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-49df272e-52e5-4d64-a6ee-f13e5a21c0cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "857fe256-77d1-451e-8353-deaa74981909", "device": "/dev/sdb"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:34:01.606584 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-49df272e-52e5-4d64-a6ee-f13e5a21c0cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:01.627770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:01.641746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-306deca9-1a13-4c1d-a4ee-b29eab27bd91 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1191 microversion: 2.1 time: 0.314400 Jul 19 12:34:01.643469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49df272e-52e5-4d64-a6ee-f13e5a21c0cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:01.644080 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49df272e-52e5-4d64-a6ee-f13e5a21c0cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:01.644564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 182/366] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:01 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1191 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:01.648734 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49df272e-52e5-4d64-a6ee-f13e5a21c0cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:01.652419 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49df272e-52e5-4d64-a6ee-f13e5a21c0cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:02.434870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-49df272e-52e5-4d64-a6ee-f13e5a21c0cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "POST /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835986 Jul 19 12:34:02.436111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 185/367] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 12:34:01 2022] POST /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:34:02.465461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-622601fc-acd8-448a-ae3f-c98d2929e216 req-7d0cf8ad-f232-4363-8028-0124592a907f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b74d78c-d928-44cd-8bed-3105d5055fed", "tag": "94eaf513-157f-4d2d-b4b9-db0f37900664"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:34:02.488353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-622601fc-acd8-448a-ae3f-c98d2929e216 req-7d0cf8ad-f232-4363-8028-0124592a907f service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:02.490137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-622601fc-acd8-448a-ae3f-c98d2929e216 req-7d0cf8ad-f232-4363-8028-0124592a907f service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:02.511335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-622601fc-acd8-448a-ae3f-c98d2929e216 req-7d0cf8ad-f232-4363-8028-0124592a907f service nova] Creating event network-changed:94eaf513-157f-4d2d-b4b9-db0f37900664 for instance 6b74d78c-d928-44cd-8bed-3105d5055fed on hv-cinder-82099 Jul 19 12:34:02.518529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-622601fc-acd8-448a-ae3f-c98d2929e216 req-7d0cf8ad-f232-4363-8028-0124592a907f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058341 Jul 19 12:34:02.519823 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 183/368] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:34:02.665728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:02.667057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:02.683084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:02.685544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:02.687957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:02.690452 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:02.838507 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:02.850460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2a660a49-be45-4363-a278-1cd86b95f07c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1209 microversion: 2.1 time: 0.192888 Jul 19 12:34:02.863729 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 186/369] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:02 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:02.891931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc934f48-2437-4151-a154-f133511292af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af31dc2b-b316-4285-9e2d-c3a3bdb6442e"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:34:02.893479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc934f48-2437-4151-a154-f133511292af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:02.900337 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc934f48-2437-4151-a154-f133511292af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:02.900781 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc934f48-2437-4151-a154-f133511292af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:02.901748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc934f48-2437-4151-a154-f133511292af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:02.902335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc934f48-2437-4151-a154-f133511292af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:03.869587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:03.870192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:03.872624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:03.878575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:03.879024 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:03.879789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:03.880249 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:04.010743 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:04.018780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-94236b57-e231-4eb1-9f62-503ad80a1edc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1277 microversion: 2.1 time: 0.152997 Jul 19 12:34:04.019341 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 187/370] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:34:05.035257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:05.035932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:05.042880 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:05.044048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:05.044864 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:05.045310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:05.180819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:05.188237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b6919fe4-68b3-4bd1-8514-cc9f9c50e8f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1277 microversion: 2.1 time: 0.156873 Jul 19 12:34:05.188799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 188/371] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:05 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:34:05.693694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=87 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:05.902935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc934f48-2437-4151-a154-f133511292af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.015520 Jul 19 12:34:05.904169 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 184/372] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 12:34:02 2022] POST /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 194 bytes in 3018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:34:06.205299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:06.206503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:06.217580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:06.218224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:06.219409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:06.219832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:06.332137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-18072217-eef2-482c-a6b0-e9f06f7142c7 req-452c2269-15a6-4cea-8811-dab70ef3be73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b6e8ae-5267-4927-8b70-b808809b7963", "tag": "8fe65a6b-0456-41c8-9993-914e784628e9"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:34:06.364690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-18072217-eef2-482c-a6b0-e9f06f7142c7 req-452c2269-15a6-4cea-8811-dab70ef3be73 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:06.365256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-18072217-eef2-482c-a6b0-e9f06f7142c7 req-452c2269-15a6-4cea-8811-dab70ef3be73 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:06.387897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-18072217-eef2-482c-a6b0-e9f06f7142c7 req-452c2269-15a6-4cea-8811-dab70ef3be73 service nova] Creating event network-changed:8fe65a6b-0456-41c8-9993-914e784628e9 for instance c1b6e8ae-5267-4927-8b70-b808809b7963 on hv-cinder-82099 Jul 19 12:34:06.394392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-18072217-eef2-482c-a6b0-e9f06f7142c7 req-452c2269-15a6-4cea-8811-dab70ef3be73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067701 Jul 19 12:34:06.395368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 185/373] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:34:06.468767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:06.477622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-52658b2c-13a9-4c12-ae33-c0250333068a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.276011 Jul 19 12:34:06.478511 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 189/374] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:07.495917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:07.496785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:07.503387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:07.503918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:07.504795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:07.505334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:07.649447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:07.657419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc72d1a0-b42e-4787-8d3c-c3a43189df04 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.166422 Jul 19 12:34:07.658531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 186/375] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:08.674713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:08.675335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:08.681867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:08.682350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:08.683207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:08.683696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:08.832806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:08.841610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-10451d25-a1df-4338-b882-953e189e0ced tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.170828 Jul 19 12:34:08.842502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 190/376] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:08 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:09.860470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:09.861091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:09.867761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:09.868304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:09.869238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:09.870482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:10.107165 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:10.119312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-17ddd717-681e-4335-9971-acbfc32f173b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.263194 Jul 19 12:34:10.120668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 187/377] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:09 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:11.136323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:11.137459 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:11.139733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:11.140413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:11.145988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:11.146439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:11.147205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:11.147644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:11.281965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:11.289385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-40b96c83-7bec-4b7e-b310-0bef3a6745fa tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.157002 Jul 19 12:34:11.289940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 191/378] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:11 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:12.306375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:12.306978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:12.308913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:12.314797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:12.315250 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:12.316013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:12.316468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:12.447692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:12.455714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0bce305f-afbb-4185-aa11-abb03dc65b87 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.153797 Jul 19 12:34:12.456299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 188/379] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:12 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:13.472296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:13.472933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:13.479313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:13.479764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:13.480610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:13.481052 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:13.608551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:13.616320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f92bfa7f-e2c4-401d-ac8f-f343b9e20ef8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.147894 Jul 19 12:34:13.616892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 192/380] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:14.633588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:14.634200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:14.640676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:14.641181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:14.642024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:14.642491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:14.792089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:14.799386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0050f5a6-2c4e-459e-a774-240c08184e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.169749 Jul 19 12:34:14.799944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 189/381] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:15.815405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:15.816013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:15.823943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:15.825108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:15.826109 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:15.826564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:16.005539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:16.014111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ad107072-a11a-4878-b47a-11de7b6541a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.202576 Jul 19 12:34:16.014962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 193/382] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:15 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:17.031085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:17.031699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:17.038192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:17.038644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:17.039405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:17.039839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:17.170130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:17.177724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d6c92f8-0363-4310-8ccf-fb9f307c6e64 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.150815 Jul 19 12:34:17.178444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 190/383] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:17.635521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-8d814535-814b-430e-92c2-5851702c208a req-567838d6-792e-4da0-8bc0-50004bf8f299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b6e8ae-5267-4927-8b70-b808809b7963", "name": "network-vif-plugged", "status": "completed", "tag": "8fe65a6b-0456-41c8-9993-914e784628e9"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:34:17.645217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-8d814535-814b-430e-92c2-5851702c208a req-567838d6-792e-4da0-8bc0-50004bf8f299 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:17.645671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-8d814535-814b-430e-92c2-5851702c208a req-567838d6-792e-4da0-8bc0-50004bf8f299 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:17.656782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-8d814535-814b-430e-92c2-5851702c208a req-567838d6-792e-4da0-8bc0-50004bf8f299 service nova] Creating event network-vif-plugged:8fe65a6b-0456-41c8-9993-914e784628e9 for instance c1b6e8ae-5267-4927-8b70-b808809b7963 on hv-cinder-82099 Jul 19 12:34:17.661876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-8d814535-814b-430e-92c2-5851702c208a req-567838d6-792e-4da0-8bc0-50004bf8f299 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030006 Jul 19 12:34:17.662739 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 194/384] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:34:18.197361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:18.197973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:18.205016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:18.205471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:18.206273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:18.206711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:18.335360 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:18.343336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1939f409-bfe1-4cf1-93f3-5b2800afda15 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.149907 Jul 19 12:34:18.343907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 191/385] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:19.361283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:19.361991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:19.368116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:19.368600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:19.369362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:19.369801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:19.501090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:19.508751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-50f480bf-d1d1-41ee-88b7-62d21604815f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1265 microversion: 2.1 time: 0.151887 Jul 19 12:34:19.509354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 195/386] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:20.525642 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:20.526256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:20.532800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:20.533258 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:20.534023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:20.534462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:20.664316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:20.672381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8bdd7a2f-b266-49c8-b188-a31d80e310db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1451 microversion: 2.1 time: 0.150602 Jul 19 12:34:20.672949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 192/387] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:20.688520 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:34:20.689149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:20.695538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:20.695997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:20.696805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:20.697252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:20.711624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:21.041195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:34:21.049218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7ad356bf-c481-4c1f-bdc7-ebc2ecee4691 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1451 microversion: 2.1 time: 0.364487 Jul 19 12:34:21.049782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 196/388] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:34:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1451 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:34:22.887179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-de94de22-a71e-47be-8f4d-5dae77cdd2cf req-d35a57d0-c482-41ee-b1ed-f557165a06c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b6e8ae-5267-4927-8b70-b808809b7963", "tag": "8fe65a6b-0456-41c8-9993-914e784628e9"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:34:22.895607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-de94de22-a71e-47be-8f4d-5dae77cdd2cf req-d35a57d0-c482-41ee-b1ed-f557165a06c4 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:22.896055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-de94de22-a71e-47be-8f4d-5dae77cdd2cf req-d35a57d0-c482-41ee-b1ed-f557165a06c4 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:22.907282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-de94de22-a71e-47be-8f4d-5dae77cdd2cf req-d35a57d0-c482-41ee-b1ed-f557165a06c4 service nova] Creating event network-changed:8fe65a6b-0456-41c8-9993-914e784628e9 for instance c1b6e8ae-5267-4927-8b70-b808809b7963 on hv-cinder-82099 Jul 19 12:34:22.912209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-de94de22-a71e-47be-8f4d-5dae77cdd2cf req-d35a57d0-c482-41ee-b1ed-f557165a06c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028799 Jul 19 12:34:22.912799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 193/389] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:34:38.632744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fad581d9-4cbd-44ec-b25e-ffd32f24f646 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0916ccc8-dc1d-4734-88a7-375aedbe37a9"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:34:38.633806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fad581d9-4cbd-44ec-b25e-ffd32f24f646 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:34:38.635817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=19 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:38.636491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:38.642717 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad581d9-4cbd-44ec-b25e-ffd32f24f646 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:38.643168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad581d9-4cbd-44ec-b25e-ffd32f24f646 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:38.643938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad581d9-4cbd-44ec-b25e-ffd32f24f646 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:34:38.644411 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad581d9-4cbd-44ec-b25e-ffd32f24f646 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:34:48.642141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:48.713250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:01.722713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fad581d9-4cbd-44ec-b25e-ffd32f24f646 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "POST /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 23.093968 Jul 19 12:35:01.723356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 197/390] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 12:34:38 2022] POST /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed/os-volume_attachments => generated 194 bytes in 23095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:03.031614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=33 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:03.032345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:03.036721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02fab6f9-a7fa-4757-8482-114d26da7559 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: .version_select at 0x7fd994471550>, body: {"keypair": {"name": "tempest-keypair-317922800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/sYW6Y0E2zfNAhcRFkmgghOh+nVw0P3DFSGFkRC0fKNwF+OznFH9ya+74HkqlHSeA3QUhl77FOGBb0SNd8jtMWKFctlGw3KS2ez/ge9XSE/ATttVIS+iay2m6f6O7Vlg=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:35:03.053776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-02fab6f9-a7fa-4757-8482-114d26da7559 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:35:03.057566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-02fab6f9-a7fa-4757-8482-114d26da7559 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:35:03.079576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02fab6f9-a7fa-4757-8482-114d26da7559 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049586 Jul 19 12:35:03.080337 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 194/391] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 12:35:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:04.393456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-348615159", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbcf9e05-75a4-4a6f-9f4c-53034463b4ca"}], "security_groups": [{"name": "tempest-securitygroup--727880746"}], "key_name": "tempest-keypair-317922800", "user_data": "}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:35:04.494165 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] validate_networks() for [('dbcf9e05-75a4-4a6f-9f4c-53034463b4ca', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:35:04.867203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:35:04.867633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:35:04.868106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:35:04.868541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:35:04.868955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:35:04.878077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:04.878528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:04.879331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:04.879807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:04.896328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:35:04.900414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:35:04.912026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:35:04.914475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:35:04.962173 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e3d5f0ca-867f-468b-b2fe-b0983d285488 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573344 Jul 19 12:35:04.962832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 198/392] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:35:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:35:04.973236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c28210e0-d378-4625-8b1a-ef6cd8583416 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:04.973972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c28210e0-d378-4625-8b1a-ef6cd8583416 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:05.028081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c28210e0-d378-4625-8b1a-ef6cd8583416 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:05.035294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c28210e0-d378-4625-8b1a-ef6cd8583416 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1240 microversion: 2.1 time: 0.065950 Jul 19 12:35:05.035888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 195/393] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:04 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:06.052520 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:06.053159 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:06.060932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:06.061984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:06.062767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:06.063204 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:06.136343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:06.143913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a74219ec-0a9d-4097-8ade-a2a05ccd26ed tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1310 microversion: 2.1 time: 0.095175 Jul 19 12:35:06.144523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 199/394] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:06 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:07.162555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:07.163812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:07.170888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:07.172257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:07.173068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:07.173519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:07.380641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:07.390923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e81ab7ad-f252-46dc-b845-4e048145dcce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1365 microversion: 2.1 time: 0.233001 Jul 19 12:35:07.392083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 196/395] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:07 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:07.478786 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-1dffec27-6a20-40e5-a5eb-5c7a879cd257 req-2bdc3a93-d35a-4455-87ac-669e6f35d5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc37091a-e1a5-4272-b216-e15ef76abfc3", "tag": "a2904603-cdc5-40e9-803c-6b2ce3a2b4e5"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:35:07.491069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-1dffec27-6a20-40e5-a5eb-5c7a879cd257 req-2bdc3a93-d35a-4455-87ac-669e6f35d5ca service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:07.491887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-1dffec27-6a20-40e5-a5eb-5c7a879cd257 req-2bdc3a93-d35a-4455-87ac-669e6f35d5ca service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:07.505439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-1dffec27-6a20-40e5-a5eb-5c7a879cd257 req-2bdc3a93-d35a-4455-87ac-669e6f35d5ca service nova] Creating event network-changed:a2904603-cdc5-40e9-803c-6b2ce3a2b4e5 for instance dc37091a-e1a5-4272-b216-e15ef76abfc3 on hv-cinder-82099 Jul 19 12:35:07.510404 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-1dffec27-6a20-40e5-a5eb-5c7a879cd257 req-2bdc3a93-d35a-4455-87ac-669e6f35d5ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036685 Jul 19 12:35:07.511031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 200/396] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:08.406570 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:08.407104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:08.413664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:08.414113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:08.414873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:08.415304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:08.542731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:08.550629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-985117f8-33af-4cf0-a55a-1e92235aaeea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1365 microversion: 2.1 time: 0.147859 Jul 19 12:35:08.551176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 197/397] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:08 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:09.568984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:09.569699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:09.575983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:09.576476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:09.577913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:09.578364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:09.778897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:09.786657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-73fe75b5-6f54-43d0-a85a-d0f8cdebb656 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1365 microversion: 2.1 time: 0.222437 Jul 19 12:35:09.787250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 201/398] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:09 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:35:10.803914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:10.804706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:10.811532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:10.811978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:10.812773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:10.813210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:11.017741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:11.025272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b3a7d37-2cb2-413d-9ae7-634273c52df3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1365 microversion: 2.1 time: 0.225221 Jul 19 12:35:11.025840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 198/399] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:10 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:11.888697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-1e29e6d8-5321-4aa8-a555-78e124348189 req-bf73d38c-b45a-4b03-9d91-3b81c19e8ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc37091a-e1a5-4272-b216-e15ef76abfc3", "name": "network-vif-plugged", "status": "completed", "tag": "a2904603-cdc5-40e9-803c-6b2ce3a2b4e5"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:35:11.898644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-1e29e6d8-5321-4aa8-a555-78e124348189 req-bf73d38c-b45a-4b03-9d91-3b81c19e8ebe service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:11.899137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-1e29e6d8-5321-4aa8-a555-78e124348189 req-bf73d38c-b45a-4b03-9d91-3b81c19e8ebe service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:11.910896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-1e29e6d8-5321-4aa8-a555-78e124348189 req-bf73d38c-b45a-4b03-9d91-3b81c19e8ebe service nova] Creating event network-vif-plugged:a2904603-cdc5-40e9-803c-6b2ce3a2b4e5 for instance dc37091a-e1a5-4272-b216-e15ef76abfc3 on hv-cinder-82099 Jul 19 12:35:11.915837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-1e29e6d8-5321-4aa8-a555-78e124348189 req-bf73d38c-b45a-4b03-9d91-3b81c19e8ebe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031581 Jul 19 12:35:11.916475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 202/400] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:12.042456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:12.043005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:12.051345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:12.052117 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:12.053014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:12.053914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:12.209698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:12.217067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-191a0c86-837c-4150-a7b7-56fcd50fb211 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1365 microversion: 2.1 time: 0.178910 Jul 19 12:35:12.218204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 199/401] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:12 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:13.235833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:13.236601 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:13.242776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:13.243224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:13.243987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:13.244446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:13.376692 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:13.384058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0c8b9da2-53a3-4541-a415-22733895fd04 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1365 microversion: 2.1 time: 0.153548 Jul 19 12:35:13.384640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 203/402] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:13 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:14.400667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:14.401269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:14.408118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:14.408530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:14.409551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:14.410049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:14.542268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:14.550230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f9e2fc01-6bce-4b74-ae29-fea576ab13f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1555 microversion: 2.1 time: 0.153358 Jul 19 12:35:14.550790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 200/403] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:14 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:14.566000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e340f1b9-cefd-45ed-aaf0-fda8d176f819 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:14.566484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e340f1b9-cefd-45ed-aaf0-fda8d176f819 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:14.572982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e340f1b9-cefd-45ed-aaf0-fda8d176f819 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:14.573440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e340f1b9-cefd-45ed-aaf0-fda8d176f819 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:14.574207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e340f1b9-cefd-45ed-aaf0-fda8d176f819 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:14.574647 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e340f1b9-cefd-45ed-aaf0-fda8d176f819 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:14.651100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e340f1b9-cefd-45ed-aaf0-fda8d176f819 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088906 Jul 19 12:35:14.651705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 204/404] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jul 19 12:35:14 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:15.847678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-48752a0d-0436-4a82-bda4-2f4dc42f05d6 req-7e14e65f-2cd2-4ca0-9b5f-34e675a8eb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc37091a-e1a5-4272-b216-e15ef76abfc3", "tag": "a2904603-cdc5-40e9-803c-6b2ce3a2b4e5"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:35:15.852102 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:15.858293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-48752a0d-0436-4a82-bda4-2f4dc42f05d6 req-7e14e65f-2cd2-4ca0-9b5f-34e675a8eb31 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:15.859260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-48752a0d-0436-4a82-bda4-2f4dc42f05d6 req-7e14e65f-2cd2-4ca0-9b5f-34e675a8eb31 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:15.871955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-48752a0d-0436-4a82-bda4-2f4dc42f05d6 req-7e14e65f-2cd2-4ca0-9b5f-34e675a8eb31 service nova] Creating event network-changed:a2904603-cdc5-40e9-803c-6b2ce3a2b4e5 for instance dc37091a-e1a5-4272-b216-e15ef76abfc3 on hv-cinder-82099 Jul 19 12:35:15.878273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-48752a0d-0436-4a82-bda4-2f4dc42f05d6 req-7e14e65f-2cd2-4ca0-9b5f-34e675a8eb31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034305 Jul 19 12:35:15.879156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 201/405] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:49.713315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:49.714079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:49.715366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:49.716168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:49.721083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c4fdf7fe-2822-47bb-a3b3-5ee7ef44baf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:49.721577 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c4fdf7fe-2822-47bb-a3b3-5ee7ef44baf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:49.729808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4fdf7fe-2822-47bb-a3b3-5ee7ef44baf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.730321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4fdf7fe-2822-47bb-a3b3-5ee7ef44baf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:49.731083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4fdf7fe-2822-47bb-a3b3-5ee7ef44baf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.731524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4fdf7fe-2822-47bb-a3b3-5ee7ef44baf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:49.755753 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c4fdf7fe-2822-47bb-a3b3-5ee7ef44baf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3/ips" status: 200 len: 150 microversion: 2.1 time: 0.043264 Jul 19 12:35:49.756336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 205/406] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:35:49 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:35:49.764515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:49.765308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=32 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:49.769733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af31dc2b-b316-4285-9e2d-c3a3bdb6442e"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:35:49.770872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:49.778178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.778632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:49.779400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.779839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:49.856701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Invalid volume: volume af31dc2b-b316-4285-9e2d-c3a3bdb6442e is already attached to instances: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: POST /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3/os-volume_attachments HTTP/1.1 Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 74 Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:35:49.858542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {"volumeAttachment": {"volumeId": "af31dc2b-b316-4285-9e2d-c3a3bdb6442e"}} Jul 19 12:35:49.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Invalid volume: volume af31dc2b-b316-4285-9e2d-c3a3bdb6442e is already attached to instances: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'dc37091a-e1a5-4272-b216-e15ef76abfc3', 'body': {'volumeAttachment': {'volumeId': 'af31dc2b-b316-4285-9e2d-c3a3bdb6442e'}}} Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af31dc2b-b316-4285-9e2d-c3a3bdb6442e is already attached to instances: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:49.861747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af31dc2b-b316-4285-9e2d-c3a3bdb6442e is already attached to instances: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:35:49.863292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af31dc2b-b316-4285-9e2d-c3a3bdb6442e is already attached to instances: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 400 to user: Invalid volume: volume af31dc2b-b316-4285-9e2d-c3a3bdb6442e is already attached to instances: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c2516526-e645-46bd-ac26-e0ba4008db36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097016 Jul 19 12:35:49.865112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 202/407] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 12:35:49 2022] POST /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 12:35:49.869077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:49.869569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:49.875679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.876131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:49.876906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.877343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:49.900709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Going to try to terminate instance {{(pid=118119) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:35:49.975744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ab5f46d5-e363-4788-8764-9cdf3e279e14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 204 len: 0 microversion: 2.1 time: 0.109859 Jul 19 12:35:49.976375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 206/408] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:35:49 2022] DELETE /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:35:49.984355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:49.984966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:49.992449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.992910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:49.993664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:49.994101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:50.122268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:50.129973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-76892fd1-bbc9-471a-902c-1b2439ebe33d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1680 microversion: 2.1 time: 0.149462 Jul 19 12:35:50.130545 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 203/409] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:49 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:51.146939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:51.147566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:51.155076 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:51.155538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:51.156370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:51.156825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:51.292115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:51.300087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9d84947d-1dc0-4a50-a2c4-79997218710f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1680 microversion: 2.1 time: 0.157591 Jul 19 12:35:51.300684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 207/410] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:51 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:52.201786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-1844a4ea-163b-493b-93d4-c6a7a5427298 req-5cd5d08d-b4ed-4ce7-9279-5e8432ec6b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc37091a-e1a5-4272-b216-e15ef76abfc3", "name": "network-vif-deleted", "tag": "a2904603-cdc5-40e9-803c-6b2ce3a2b4e5"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:35:52.212799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-1844a4ea-163b-493b-93d4-c6a7a5427298 req-5cd5d08d-b4ed-4ce7-9279-5e8432ec6b52 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:52.213243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-1844a4ea-163b-493b-93d4-c6a7a5427298 req-5cd5d08d-b4ed-4ce7-9279-5e8432ec6b52 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:52.229734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-1844a4ea-163b-493b-93d4-c6a7a5427298 req-5cd5d08d-b4ed-4ce7-9279-5e8432ec6b52 service nova] Creating event network-vif-deleted:a2904603-cdc5-40e9-803c-6b2ce3a2b4e5 for instance dc37091a-e1a5-4272-b216-e15ef76abfc3 on hv-cinder-82099 Jul 19 12:35:52.235622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-1844a4ea-163b-493b-93d4-c6a7a5427298 req-5cd5d08d-b4ed-4ce7-9279-5e8432ec6b52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038953 Jul 19 12:35:52.236982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 204/411] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:52.319783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:52.321092 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:52.328265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:52.328928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:52.331163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:52.331757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:52.374147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:52.375099 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:52.375742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lazy-loading 'fault' on Instance uuid dc37091a-e1a5-4272-b216-e15ef76abfc3 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:35:52.428896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:35:52.436339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-820a2213-29fb-44dd-9ee6-cf0bbba187ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 200 len: 1330 microversion: 2.1 time: 0.123220 Jul 19 12:35:52.436909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 208/412] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:52 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:35:53.455590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:53.456340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:53.463681 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:53.464137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:53.464971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:53.465418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:53.480431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 HTTP/1.1 Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:35:53.482107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 12:35:53.483656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'dc37091a-e1a5-4272-b216-e15ef76abfc3'} Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:35:53.484562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 12:35:53.486142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:35:53.488095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:35:53.488095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e52188a7-619f-41a9-8bbf-a0cd0c1c8e65 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 404 len: 111 microversion: 2.1 time: 0.032929 Jul 19 12:35:53.495884 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-39ef21f4-c25c-4b1c-845d-ccc12f64642f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '.version_select at 0x7fd99434cdc0>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:53.499637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39ef21f4-c25c-4b1c-845d-ccc12f64642f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [5e222b83-e6c4-4035-a5ac-3196d4bc6378] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 12:35:53.500306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 205/413] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:35:53 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:35:54.507649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [None req-39ef21f4-c25c-4b1c-845d-ccc12f64642f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [5e222b83-e6c4-4035-a5ac-3196d4bc6378] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58360. Jul 19 12:35:54.525822 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-39ef21f4-c25c-4b1c-845d-ccc12f64642f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317922800" status: 202 len: 0 microversion: 2.1 time: 1.035572 Jul 19 12:35:54.526397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 209/414] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jul 19 12:35:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317922800 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 12:35:55.177340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:55.177832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:55.184344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:55.184790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:55.185544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:55.185975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:55.307101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lazy-loading 'services' on Instance uuid dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:35:55.416801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-137c740f-8bcb-416c-a17d-4e0a9ffb1303 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments/af31dc2b-b316-4285-9e2d-c3a3bdb6442e" status: 202 len: 0 microversion: 2.1 time: 0.243585 Jul 19 12:35:55.417562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 206/415] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:35:55 2022] DELETE /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments/af31dc2b-b316-4285-9e2d-c3a3bdb6442e => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 12:35:55.426029 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8affd4c5-da1b-4113-ae9c-1a0efb63c4f6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:55.427626 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8affd4c5-da1b-4113-ae9c-1a0efb63c4f6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:55.435644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8affd4c5-da1b-4113-ae9c-1a0efb63c4f6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:55.435790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8affd4c5-da1b-4113-ae9c-1a0efb63c4f6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:55.436587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8affd4c5-da1b-4113-ae9c-1a0efb63c4f6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:55.437207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8affd4c5-da1b-4113-ae9c-1a0efb63c4f6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:55.472083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8affd4c5-da1b-4113-ae9c-1a0efb63c4f6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050431 Jul 19 12:35:55.472946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 210/416] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:35:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:56.483837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94ceb335-aacc-411e-a11a-37e52dd13a32 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:56.484870 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94ceb335-aacc-411e-a11a-37e52dd13a32 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:56.492334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94ceb335-aacc-411e-a11a-37e52dd13a32 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:56.492782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94ceb335-aacc-411e-a11a-37e52dd13a32 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:56.493548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94ceb335-aacc-411e-a11a-37e52dd13a32 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:56.493980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94ceb335-aacc-411e-a11a-37e52dd13a32 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:56.522542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94ceb335-aacc-411e-a11a-37e52dd13a32 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Jul 19 12:35:56.523099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 207/417] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:35:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:57.533238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4f22b293-f16a-4cb5-a2b3-7585453ba820 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:57.534746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4f22b293-f16a-4cb5-a2b3-7585453ba820 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:57.541133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f22b293-f16a-4cb5-a2b3-7585453ba820 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:57.541590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f22b293-f16a-4cb5-a2b3-7585453ba820 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:57.542355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f22b293-f16a-4cb5-a2b3-7585453ba820 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:57.542794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f22b293-f16a-4cb5-a2b3-7585453ba820 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:57.571705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4f22b293-f16a-4cb5-a2b3-7585453ba820 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Jul 19 12:35:57.572445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 211/418] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:35:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:58.582763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c111b0be-0d74-4230-9dd0-db5d197fc8d1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:58.583721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c111b0be-0d74-4230-9dd0-db5d197fc8d1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:58.590065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c111b0be-0d74-4230-9dd0-db5d197fc8d1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:58.590512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c111b0be-0d74-4230-9dd0-db5d197fc8d1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:58.591281 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c111b0be-0d74-4230-9dd0-db5d197fc8d1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:58.591716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c111b0be-0d74-4230-9dd0-db5d197fc8d1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:58.623518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c111b0be-0d74-4230-9dd0-db5d197fc8d1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 Jul 19 12:35:58.624091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 208/419] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:35:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:35:59.634650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-43b3ad3a-014c-4f3a-87fb-4c6c9c55d560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:35:59.635569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-43b3ad3a-014c-4f3a-87fb-4c6c9c55d560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:35:59.641946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b3ad3a-014c-4f3a-87fb-4c6c9c55d560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:59.642399 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b3ad3a-014c-4f3a-87fb-4c6c9c55d560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:59.643751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b3ad3a-014c-4f3a-87fb-4c6c9c55d560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:35:59.644201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b3ad3a-014c-4f3a-87fb-4c6c9c55d560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:35:59.672589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-43b3ad3a-014c-4f3a-87fb-4c6c9c55d560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Jul 19 12:35:59.673144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 212/420] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:35:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:00.684281 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2c46a0d4-c3c9-4aeb-8382-526964994bcb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:00.685197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2c46a0d4-c3c9-4aeb-8382-526964994bcb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:00.692148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c46a0d4-c3c9-4aeb-8382-526964994bcb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:00.692626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c46a0d4-c3c9-4aeb-8382-526964994bcb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:00.693387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c46a0d4-c3c9-4aeb-8382-526964994bcb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:00.693818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c46a0d4-c3c9-4aeb-8382-526964994bcb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:00.730941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2c46a0d4-c3c9-4aeb-8382-526964994bcb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050534 Jul 19 12:36:00.731523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 209/421] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:01.742955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b03aefd1-c93a-4951-a4a2-33cbdd724bec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:01.743874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b03aefd1-c93a-4951-a4a2-33cbdd724bec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:01.750932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b03aefd1-c93a-4951-a4a2-33cbdd724bec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:01.751387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b03aefd1-c93a-4951-a4a2-33cbdd724bec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:01.753335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b03aefd1-c93a-4951-a4a2-33cbdd724bec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:01.753758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b03aefd1-c93a-4951-a4a2-33cbdd724bec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:01.784550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b03aefd1-c93a-4951-a4a2-33cbdd724bec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Jul 19 12:36:01.785107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 213/422] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:02.795748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-938dba81-90f5-401e-9ce2-bab9daf6ac5f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:02.796732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-938dba81-90f5-401e-9ce2-bab9daf6ac5f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:02.803242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-938dba81-90f5-401e-9ce2-bab9daf6ac5f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:02.803689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-938dba81-90f5-401e-9ce2-bab9daf6ac5f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:02.804510 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-938dba81-90f5-401e-9ce2-bab9daf6ac5f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:02.804946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-938dba81-90f5-401e-9ce2-bab9daf6ac5f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:02.833666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-938dba81-90f5-401e-9ce2-bab9daf6ac5f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041868 Jul 19 12:36:02.834365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 210/423] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:03.845082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-08c0951d-3098-4bd2-9d45-bf99cd124842 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:03.846002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-08c0951d-3098-4bd2-9d45-bf99cd124842 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:03.851921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08c0951d-3098-4bd2-9d45-bf99cd124842 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:03.852485 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08c0951d-3098-4bd2-9d45-bf99cd124842 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:03.853236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08c0951d-3098-4bd2-9d45-bf99cd124842 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:03.853673 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08c0951d-3098-4bd2-9d45-bf99cd124842 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:03.882755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-08c0951d-3098-4bd2-9d45-bf99cd124842 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Jul 19 12:36:03.885402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 214/424] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:04.894132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cee66be8-c329-409a-97c3-282d721a6701 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:04.895056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cee66be8-c329-409a-97c3-282d721a6701 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:04.902952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee66be8-c329-409a-97c3-282d721a6701 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:04.902952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee66be8-c329-409a-97c3-282d721a6701 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:04.902952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee66be8-c329-409a-97c3-282d721a6701 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:04.903253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee66be8-c329-409a-97c3-282d721a6701 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:04.935564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cee66be8-c329-409a-97c3-282d721a6701 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Jul 19 12:36:04.936096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 211/425] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:05.949480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-44eafb63-23af-4f9d-88dc-876221f02948 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:05.950411 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-44eafb63-23af-4f9d-88dc-876221f02948 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:05.957253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44eafb63-23af-4f9d-88dc-876221f02948 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:05.957714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44eafb63-23af-4f9d-88dc-876221f02948 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:05.958491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44eafb63-23af-4f9d-88dc-876221f02948 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:05.958935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44eafb63-23af-4f9d-88dc-876221f02948 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:05.988108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-44eafb63-23af-4f9d-88dc-876221f02948 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Jul 19 12:36:05.991744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 215/426] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:06.999674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8df8795c-475f-4240-80d3-46300dc70a13 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:07.000533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8df8795c-475f-4240-80d3-46300dc70a13 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:07.007667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df8795c-475f-4240-80d3-46300dc70a13 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:07.008116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df8795c-475f-4240-80d3-46300dc70a13 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:07.008915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df8795c-475f-4240-80d3-46300dc70a13 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:07.009352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df8795c-475f-4240-80d3-46300dc70a13 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:07.038910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8df8795c-475f-4240-80d3-46300dc70a13 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Jul 19 12:36:07.039517 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 212/427] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:08.050946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-555c27f6-27af-4d73-9b0b-68874b0e1d46 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:08.051895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-555c27f6-27af-4d73-9b0b-68874b0e1d46 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:08.058340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-555c27f6-27af-4d73-9b0b-68874b0e1d46 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:08.058800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-555c27f6-27af-4d73-9b0b-68874b0e1d46 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:08.059562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-555c27f6-27af-4d73-9b0b-68874b0e1d46 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:08.060002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-555c27f6-27af-4d73-9b0b-68874b0e1d46 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:08.088576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-555c27f6-27af-4d73-9b0b-68874b0e1d46 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042028 Jul 19 12:36:08.089267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 216/428] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:09.102195 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1fce572-d973-4bbe-b171-8a54a3318e9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:09.104059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1fce572-d973-4bbe-b171-8a54a3318e9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:09.112315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1fce572-d973-4bbe-b171-8a54a3318e9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:09.113238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1fce572-d973-4bbe-b171-8a54a3318e9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:09.114086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1fce572-d973-4bbe-b171-8a54a3318e9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:09.114587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1fce572-d973-4bbe-b171-8a54a3318e9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:09.145065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1fce572-d973-4bbe-b171-8a54a3318e9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049054 Jul 19 12:36:09.145769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 213/429] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:10.157858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4839d9bd-2842-4155-af59-cc4832ca4bd6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:10.158755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4839d9bd-2842-4155-af59-cc4832ca4bd6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:10.165407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4839d9bd-2842-4155-af59-cc4832ca4bd6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:10.165894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4839d9bd-2842-4155-af59-cc4832ca4bd6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:10.166691 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4839d9bd-2842-4155-af59-cc4832ca4bd6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:10.167151 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4839d9bd-2842-4155-af59-cc4832ca4bd6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:10.201699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4839d9bd-2842-4155-af59-cc4832ca4bd6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042383 Jul 19 12:36:10.201699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 217/430] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:11.206923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-593851ed-1c82-4b13-ab92-f34fee21b77e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:11.207846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-593851ed-1c82-4b13-ab92-f34fee21b77e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:11.214428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-593851ed-1c82-4b13-ab92-f34fee21b77e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:11.214880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-593851ed-1c82-4b13-ab92-f34fee21b77e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:11.215643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-593851ed-1c82-4b13-ab92-f34fee21b77e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:11.216078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-593851ed-1c82-4b13-ab92-f34fee21b77e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:11.244707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-593851ed-1c82-4b13-ab92-f34fee21b77e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041628 Jul 19 12:36:11.245271 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 214/431] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:12.256532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1c9ec455-33b4-449e-b5d7-77064c15a4d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:12.257478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1c9ec455-33b4-449e-b5d7-77064c15a4d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:12.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9ec455-33b4-449e-b5d7-77064c15a4d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:12.264652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9ec455-33b4-449e-b5d7-77064c15a4d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:12.265418 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9ec455-33b4-449e-b5d7-77064c15a4d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:12.265857 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1c9ec455-33b4-449e-b5d7-77064c15a4d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:12.294028 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1c9ec455-33b4-449e-b5d7-77064c15a4d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041988 Jul 19 12:36:12.294576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 218/432] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:13.305264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1f7fd5ce-ef5c-4327-b027-4e94d281e507 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:13.306190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1f7fd5ce-ef5c-4327-b027-4e94d281e507 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:13.312600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f7fd5ce-ef5c-4327-b027-4e94d281e507 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:13.313050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f7fd5ce-ef5c-4327-b027-4e94d281e507 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:13.313809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f7fd5ce-ef5c-4327-b027-4e94d281e507 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:13.314244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f7fd5ce-ef5c-4327-b027-4e94d281e507 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:13.342597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1f7fd5ce-ef5c-4327-b027-4e94d281e507 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041285 Jul 19 12:36:13.343141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 215/433] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:14.354140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-46ff7017-46c9-4d33-83cf-c09cd2ca432b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:14.355060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-46ff7017-46c9-4d33-83cf-c09cd2ca432b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:14.362261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46ff7017-46c9-4d33-83cf-c09cd2ca432b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:14.362712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46ff7017-46c9-4d33-83cf-c09cd2ca432b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:14.363501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46ff7017-46c9-4d33-83cf-c09cd2ca432b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:14.363942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46ff7017-46c9-4d33-83cf-c09cd2ca432b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:14.391732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-46ff7017-46c9-4d33-83cf-c09cd2ca432b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041593 Jul 19 12:36:14.392301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 219/434] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:15.402961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-74a0da93-672f-496d-a09e-35ac11c4a99b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:15.403880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-74a0da93-672f-496d-a09e-35ac11c4a99b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:15.410306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74a0da93-672f-496d-a09e-35ac11c4a99b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:15.410754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74a0da93-672f-496d-a09e-35ac11c4a99b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:15.411505 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74a0da93-672f-496d-a09e-35ac11c4a99b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:15.411935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74a0da93-672f-496d-a09e-35ac11c4a99b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:15.440402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-74a0da93-672f-496d-a09e-35ac11c4a99b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Jul 19 12:36:15.440945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 216/435] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:16.451165 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-30684a40-893b-4bf0-89d8-cd1a710870ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:16.452090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-30684a40-893b-4bf0-89d8-cd1a710870ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:16.459037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30684a40-893b-4bf0-89d8-cd1a710870ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:16.459490 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30684a40-893b-4bf0-89d8-cd1a710870ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:16.460288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30684a40-893b-4bf0-89d8-cd1a710870ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:16.460732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30684a40-893b-4bf0-89d8-cd1a710870ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:16.485182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:16.490020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-30684a40-893b-4bf0-89d8-cd1a710870ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042890 Jul 19 12:36:16.490572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 220/436] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:17.501271 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d323fa7b-8a6e-48e5-91b3-b8b16edcb845 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:17.502195 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d323fa7b-8a6e-48e5-91b3-b8b16edcb845 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:17.508626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d323fa7b-8a6e-48e5-91b3-b8b16edcb845 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:17.509080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d323fa7b-8a6e-48e5-91b3-b8b16edcb845 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:17.509843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d323fa7b-8a6e-48e5-91b3-b8b16edcb845 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:17.510283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d323fa7b-8a6e-48e5-91b3-b8b16edcb845 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:17.545127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d323fa7b-8a6e-48e5-91b3-b8b16edcb845 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047994 Jul 19 12:36:17.545682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 217/437] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:18.557986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bb7d89a3-88af-48b0-98fb-e684194eb718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:18.558912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bb7d89a3-88af-48b0-98fb-e684194eb718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:18.566781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb7d89a3-88af-48b0-98fb-e684194eb718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:18.567243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb7d89a3-88af-48b0-98fb-e684194eb718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:18.568018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb7d89a3-88af-48b0-98fb-e684194eb718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:18.568485 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb7d89a3-88af-48b0-98fb-e684194eb718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:18.598020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bb7d89a3-88af-48b0-98fb-e684194eb718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Jul 19 12:36:18.598496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 221/438] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:19.086074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:19.086630 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:19.093000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:19.093458 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:19.094226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:19.094667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:19.120743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:36:19.134324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:19.193461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ed4cfa9-5dce-4772-9360-93f6925471d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 204 len: 0 microversion: 2.1 time: 0.110904 Jul 19 12:36:19.194120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 218/439] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:36:19 2022] DELETE /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:36:19.203049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:19.203661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:19.210034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:19.210482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:19.211239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:19.211675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:19.447332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:19.454731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bd2216ba-9ff9-451d-83d5-37574f1b37d6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1576 microversion: 2.1 time: 0.255720 Jul 19 12:36:19.455814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 222/440] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:36:19.609758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f09929c-466e-4bfb-b84f-547818fc61a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:19.610680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f09929c-466e-4bfb-b84f-547818fc61a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:19.616999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f09929c-466e-4bfb-b84f-547818fc61a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:19.617541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f09929c-466e-4bfb-b84f-547818fc61a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:19.618460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f09929c-466e-4bfb-b84f-547818fc61a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:19.618903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f09929c-466e-4bfb-b84f-547818fc61a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:19.650946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f09929c-466e-4bfb-b84f-547818fc61a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Jul 19 12:36:19.651537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 219/441] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:20.472285 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:20.472838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:20.475095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:20.480972 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:20.481461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:20.482226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:20.482667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:20.609527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:20.617043 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1490719b-57a6-4a3d-a968-09a173edd89c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1576 microversion: 2.1 time: 0.148721 Jul 19 12:36:20.617611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 223/442] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:20.662979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-065f6dfb-f58c-432f-b2f7-43f44b4883a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:20.663916 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-065f6dfb-f58c-432f-b2f7-43f44b4883a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:20.666315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:20.671529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065f6dfb-f58c-432f-b2f7-43f44b4883a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:20.671975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065f6dfb-f58c-432f-b2f7-43f44b4883a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:20.672759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065f6dfb-f58c-432f-b2f7-43f44b4883a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:20.673190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-065f6dfb-f58c-432f-b2f7-43f44b4883a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:20.703346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-065f6dfb-f58c-432f-b2f7-43f44b4883a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Jul 19 12:36:20.703908 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 220/443] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:21.634335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:21.635032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:21.641532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:21.642082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:21.643336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:21.643769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:21.715036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9af6d72f-3963-48d4-95de-df3167a6ff49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:21.716149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9af6d72f-3963-48d4-95de-df3167a6ff49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:21.723294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af6d72f-3963-48d4-95de-df3167a6ff49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:21.723818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af6d72f-3963-48d4-95de-df3167a6ff49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:21.724706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af6d72f-3963-48d4-95de-df3167a6ff49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:21.725242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af6d72f-3963-48d4-95de-df3167a6ff49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:21.735510 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:21.750903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-773307b6-be01-4ddf-a269-92b899284313 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1508 microversion: 2.1 time: 0.120481 Jul 19 12:36:21.751703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 224/444] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1508 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:21.770326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9af6d72f-3963-48d4-95de-df3167a6ff49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059261 Jul 19 12:36:21.771059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 221/445] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:36:21.800964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-8e018443-eeae-4f24-88db-424a925e474e req-fabc95bf-7dfb-4421-a187-96789dd2a072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b6e8ae-5267-4927-8b70-b808809b7963", "name": "network-vif-deleted", "tag": "8fe65a6b-0456-41c8-9993-914e784628e9"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:36:21.826999 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-8e018443-eeae-4f24-88db-424a925e474e req-fabc95bf-7dfb-4421-a187-96789dd2a072 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:21.827819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-8e018443-eeae-4f24-88db-424a925e474e req-fabc95bf-7dfb-4421-a187-96789dd2a072 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:21.841330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-8e018443-eeae-4f24-88db-424a925e474e req-fabc95bf-7dfb-4421-a187-96789dd2a072 service nova] Creating event network-vif-deleted:8fe65a6b-0456-41c8-9993-914e784628e9 for instance c1b6e8ae-5267-4927-8b70-b808809b7963 on hv-cinder-82099 Jul 19 12:36:21.847270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-8e018443-eeae-4f24-88db-424a925e474e req-fabc95bf-7dfb-4421-a187-96789dd2a072 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053585 Jul 19 12:36:21.848464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 225/446] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:22.768027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:22.768662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:22.775147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:22.775602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:22.776399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:22.776837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:22.782751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bb53dad3-2942-460a-a5aa-8e3ed4737ff0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:22.784322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bb53dad3-2942-460a-a5aa-8e3ed4737ff0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:22.790587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb53dad3-2942-460a-a5aa-8e3ed4737ff0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:22.791034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb53dad3-2942-460a-a5aa-8e3ed4737ff0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:22.791796 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb53dad3-2942-460a-a5aa-8e3ed4737ff0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:22.792261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb53dad3-2942-460a-a5aa-8e3ed4737ff0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:22.822021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bb53dad3-2942-460a-a5aa-8e3ed4737ff0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Jul 19 12:36:22.822576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 226/447] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:36:22.894875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:22.902622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52709d97-1c81-4114-8532-23a498e6ac55 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.138499 Jul 19 12:36:22.903185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 222/448] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:22 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:23.833585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-86baf50d-033c-41b1-9316-9a30b5cca6a7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:23.834498 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-86baf50d-033c-41b1-9316-9a30b5cca6a7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:23.840923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86baf50d-033c-41b1-9316-9a30b5cca6a7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:23.841378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86baf50d-033c-41b1-9316-9a30b5cca6a7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:23.842132 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86baf50d-033c-41b1-9316-9a30b5cca6a7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:23.842571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86baf50d-033c-41b1-9316-9a30b5cca6a7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:23.870963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-86baf50d-033c-41b1-9316-9a30b5cca6a7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041244 Jul 19 12:36:23.871440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 227/449] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:23.919629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:23.920260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:23.927300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:23.927746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:23.928533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:23.928969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:23.988156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:23.995564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f4e6d56d-fe8d-442c-9a4d-241ac3ff08f3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080777 Jul 19 12:36:23.996125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 223/450] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:23 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:24.883479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b02c5b07-7f87-415d-82d9-1cb1cfbb35b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:24.884424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b02c5b07-7f87-415d-82d9-1cb1cfbb35b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:24.890825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b02c5b07-7f87-415d-82d9-1cb1cfbb35b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:24.891280 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b02c5b07-7f87-415d-82d9-1cb1cfbb35b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:24.892051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b02c5b07-7f87-415d-82d9-1cb1cfbb35b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:24.893086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b02c5b07-7f87-415d-82d9-1cb1cfbb35b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:24.920765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b02c5b07-7f87-415d-82d9-1cb1cfbb35b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041346 Jul 19 12:36:24.921310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 228/451] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:25.012661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:25.013270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:25.020268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:25.020721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:25.021485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:25.021925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:25.081709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:25.089083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d27543dc-a22c-4d37-a95a-c437c485bbbc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080228 Jul 19 12:36:25.089651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 224/452] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:25 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:25.931583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8b85cc21-304d-488f-9cad-bb81078bb156 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:25.932464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8b85cc21-304d-488f-9cad-bb81078bb156 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:25.940346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b85cc21-304d-488f-9cad-bb81078bb156 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:25.940802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b85cc21-304d-488f-9cad-bb81078bb156 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:25.941561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b85cc21-304d-488f-9cad-bb81078bb156 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:25.941998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b85cc21-304d-488f-9cad-bb81078bb156 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:25.971154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8b85cc21-304d-488f-9cad-bb81078bb156 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Jul 19 12:36:25.971700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 229/453] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:26.105325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:26.105937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:26.112364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:26.112821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:26.113597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:26.114032 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:26.173659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:26.180973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d68dc007-603b-4107-ba6d-c3b7bb860a73 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079470 Jul 19 12:36:26.181529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 225/454] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:26 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:26.981821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9d3ab409-55a5-4f9a-8896-69c127e92f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:26.982766 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9d3ab409-55a5-4f9a-8896-69c127e92f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:26.989891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d3ab409-55a5-4f9a-8896-69c127e92f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:26.990342 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d3ab409-55a5-4f9a-8896-69c127e92f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:26.991097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d3ab409-55a5-4f9a-8896-69c127e92f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:26.991797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9d3ab409-55a5-4f9a-8896-69c127e92f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:27.020329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9d3ab409-55a5-4f9a-8896-69c127e92f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Jul 19 12:36:27.020866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 230/455] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:27.197417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:27.198024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:27.204507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:27.204960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:27.205722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:27.206159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:27.268987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:27.276551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3662b58b-ae92-47b1-b331-4864dc5e5f7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082913 Jul 19 12:36:27.277118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 226/456] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:27 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:28.033334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3e94ce8e-db7e-49ec-a347-6dac5bf7f8e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:28.034258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3e94ce8e-db7e-49ec-a347-6dac5bf7f8e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:28.040622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e94ce8e-db7e-49ec-a347-6dac5bf7f8e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:28.041089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e94ce8e-db7e-49ec-a347-6dac5bf7f8e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:28.041858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e94ce8e-db7e-49ec-a347-6dac5bf7f8e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:28.042300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e94ce8e-db7e-49ec-a347-6dac5bf7f8e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:28.071122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3e94ce8e-db7e-49ec-a347-6dac5bf7f8e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042250 Jul 19 12:36:28.071682 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 231/457] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:36:28.293457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:28.293991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:28.300498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:28.300940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:28.301701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:28.302130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:28.364082 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:28.371419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad74c464-d197-4e47-991e-4ab1cdd15cbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081875 Jul 19 12:36:28.371974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 227/458] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:28 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:29.083439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-429dfba0-38a6-4162-8a87-b33b7cf53f78 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:29.084393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-429dfba0-38a6-4162-8a87-b33b7cf53f78 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:29.092361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429dfba0-38a6-4162-8a87-b33b7cf53f78 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:29.092882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429dfba0-38a6-4162-8a87-b33b7cf53f78 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:29.093709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429dfba0-38a6-4162-8a87-b33b7cf53f78 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:29.094154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429dfba0-38a6-4162-8a87-b33b7cf53f78 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:29.122866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-429dfba0-38a6-4162-8a87-b33b7cf53f78 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Jul 19 12:36:29.123427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 232/459] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:29.387327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:29.388865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:29.394985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:29.395441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:29.396237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:29.396682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:29.460013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:29.467458 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db5d7c0a-157c-4484-b8b3-2f7a586e6cb6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084002 Jul 19 12:36:29.468016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 228/460] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:29 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:30.134788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d8876039-c327-4a16-89c2-0efa88b714e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:30.135698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d8876039-c327-4a16-89c2-0efa88b714e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:30.142049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8876039-c327-4a16-89c2-0efa88b714e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:30.142499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8876039-c327-4a16-89c2-0efa88b714e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:30.143250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8876039-c327-4a16-89c2-0efa88b714e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:30.143684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8876039-c327-4a16-89c2-0efa88b714e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:30.171649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d8876039-c327-4a16-89c2-0efa88b714e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 Jul 19 12:36:30.172405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 233/461] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:30.483776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:30.484416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:30.490872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:30.491319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:30.492103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:30.492561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:30.553995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:30.561660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a9fbd0ed-b860-453b-a0f9-8939d0a7d488 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081738 Jul 19 12:36:30.562226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 229/462] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:30 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:31.183493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9491a1fc-04b2-456c-a4ac-88a4d244ae8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:31.184567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9491a1fc-04b2-456c-a4ac-88a4d244ae8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:31.192160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491a1fc-04b2-456c-a4ac-88a4d244ae8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:31.192635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491a1fc-04b2-456c-a4ac-88a4d244ae8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:31.193407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491a1fc-04b2-456c-a4ac-88a4d244ae8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:31.193840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491a1fc-04b2-456c-a4ac-88a4d244ae8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:31.224986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9491a1fc-04b2-456c-a4ac-88a4d244ae8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Jul 19 12:36:31.225544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 234/463] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:31.578849 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:31.579490 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:31.585661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:31.586114 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:31.586878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:31.587316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:31.650611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:31.658668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8d5656bd-12b0-41ac-b08b-0abcf56e6365 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083678 Jul 19 12:36:31.659233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 230/464] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:31 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:32.236791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-89c2b234-73fc-4b25-a743-5f1b81b28433 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:32.237719 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-89c2b234-73fc-4b25-a743-5f1b81b28433 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:32.243747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-89c2b234-73fc-4b25-a743-5f1b81b28433 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:32.244233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-89c2b234-73fc-4b25-a743-5f1b81b28433 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:32.245007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-89c2b234-73fc-4b25-a743-5f1b81b28433 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:32.245457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-89c2b234-73fc-4b25-a743-5f1b81b28433 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:32.273958 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-89c2b234-73fc-4b25-a743-5f1b81b28433 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 Jul 19 12:36:32.274494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 235/465] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:32.674549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:32.675193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:32.681820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:32.682272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:32.683037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:32.683477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:32.745016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:32.757090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ba74cc0-cfb4-4a41-ab1d-e72c04ae80d1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.086416 Jul 19 12:36:32.757664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 231/466] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:32 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:33.285973 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e5bc19ce-a8da-4739-8894-351422e9baf8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:33.286884 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e5bc19ce-a8da-4739-8894-351422e9baf8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:33.293359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e5bc19ce-a8da-4739-8894-351422e9baf8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:33.293810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e5bc19ce-a8da-4739-8894-351422e9baf8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:33.294561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e5bc19ce-a8da-4739-8894-351422e9baf8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:33.295019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e5bc19ce-a8da-4739-8894-351422e9baf8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:33.323079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e5bc19ce-a8da-4739-8894-351422e9baf8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 Jul 19 12:36:33.323614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 236/467] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:33.774002 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:33.774605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:33.787670 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:33.788124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:33.788919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:33.789356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:33.852622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:33.859852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d067f54-ba81-4899-8dcf-43e9459cba28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.089679 Jul 19 12:36:33.860451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 232/468] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:33 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:34.336627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0666cedd-ab3f-4136-86de-030dfb44d62b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:34.337963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0666cedd-ab3f-4136-86de-030dfb44d62b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:34.344665 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0666cedd-ab3f-4136-86de-030dfb44d62b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:34.345120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0666cedd-ab3f-4136-86de-030dfb44d62b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:34.345882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0666cedd-ab3f-4136-86de-030dfb44d62b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:34.346323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0666cedd-ab3f-4136-86de-030dfb44d62b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:34.375866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0666cedd-ab3f-4136-86de-030dfb44d62b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Jul 19 12:36:34.377051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 237/469] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:34.876731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:34.877251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:34.883651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:34.884103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:34.884898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:34.885332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:34.944777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:34.952085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d81f0b73-1c8c-44b6-9ac6-cccb64305e24 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079632 Jul 19 12:36:34.952679 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 233/470] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:34 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:35.387990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-405682f7-01d0-42e2-8765-33d69f4d5759 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:35.388937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-405682f7-01d0-42e2-8765-33d69f4d5759 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:35.396006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-405682f7-01d0-42e2-8765-33d69f4d5759 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:35.396489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-405682f7-01d0-42e2-8765-33d69f4d5759 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:35.397245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-405682f7-01d0-42e2-8765-33d69f4d5759 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:35.397681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-405682f7-01d0-42e2-8765-33d69f4d5759 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:35.401322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:35.426088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-405682f7-01d0-42e2-8765-33d69f4d5759 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Jul 19 12:36:35.426629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 238/471] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:35.969065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:35.969679 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:35.976163 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:35.976649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:35.977424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:35.977866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:35.981825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:36.045013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:36.053559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cedc39dd-5f7b-4a0a-9719-0be0b4f13c86 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088285 Jul 19 12:36:36.054129 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 234/472] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:35 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:36.437964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c6624eed-1dc8-49f3-ba1c-cfada3cccf3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:36.438877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c6624eed-1dc8-49f3-ba1c-cfada3cccf3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:36.445326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6624eed-1dc8-49f3-ba1c-cfada3cccf3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:36.445776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6624eed-1dc8-49f3-ba1c-cfada3cccf3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:36.446532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6624eed-1dc8-49f3-ba1c-cfada3cccf3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:36.446968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6624eed-1dc8-49f3-ba1c-cfada3cccf3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:36.475479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c6624eed-1dc8-49f3-ba1c-cfada3cccf3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041915 Jul 19 12:36:36.476011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 239/473] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:37.070858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:37.071517 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:37.078963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:37.080043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:37.080825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:37.081264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:37.140869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:37.148881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0a71057-bb63-43a7-ba0a-42e49c2f6645 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081897 Jul 19 12:36:37.149443 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 235/474] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:37 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:36:37.487591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d30bad56-ebc4-48b5-b3df-36583d82f55b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:37.488567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d30bad56-ebc4-48b5-b3df-36583d82f55b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:37.494933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d30bad56-ebc4-48b5-b3df-36583d82f55b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:37.495384 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d30bad56-ebc4-48b5-b3df-36583d82f55b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:37.496143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d30bad56-ebc4-48b5-b3df-36583d82f55b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:37.496604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d30bad56-ebc4-48b5-b3df-36583d82f55b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:37.525204 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d30bad56-ebc4-48b5-b3df-36583d82f55b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Jul 19 12:36:37.525748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 240/475] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:38.165231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:38.165834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:38.172418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:38.172866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:38.173639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:38.174048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:38.233530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:38.240879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-58392a8f-60b8-482c-81cd-843cc83d2291 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079437 Jul 19 12:36:38.241440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 236/476] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:38 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:38.536760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-75a19617-bdff-4019-ad74-e4e13288b604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:38.537674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-75a19617-bdff-4019-ad74-e4e13288b604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:38.544227 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75a19617-bdff-4019-ad74-e4e13288b604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:38.544689 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75a19617-bdff-4019-ad74-e4e13288b604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:38.545449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75a19617-bdff-4019-ad74-e4e13288b604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:38.545891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75a19617-bdff-4019-ad74-e4e13288b604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:38.574313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-75a19617-bdff-4019-ad74-e4e13288b604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Jul 19 12:36:38.574862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 241/477] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:39.258008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:39.258613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:39.265057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:39.265512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:39.266267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:39.266733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:39.326230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:39.334441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f75b5116-34ca-4e4f-a16e-6e60d7c04f12 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080213 Jul 19 12:36:39.334948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 237/478] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:39 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:39.586326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-99a4af3d-9aa2-420b-9ddd-d68fce916f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:39.587175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-99a4af3d-9aa2-420b-9ddd-d68fce916f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:39.593586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99a4af3d-9aa2-420b-9ddd-d68fce916f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:39.594042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99a4af3d-9aa2-420b-9ddd-d68fce916f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:39.594805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99a4af3d-9aa2-420b-9ddd-d68fce916f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:39.595247 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99a4af3d-9aa2-420b-9ddd-d68fce916f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:39.623659 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-99a4af3d-9aa2-420b-9ddd-d68fce916f17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041301 Jul 19 12:36:39.624236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 242/479] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:40.351264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:40.351867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:40.358294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:40.358741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:40.359526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:40.359955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:40.426099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:40.433560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5b3aff8a-0ffd-435a-91a5-8ca1319de2c5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.086125 Jul 19 12:36:40.434125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 238/480] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:40 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:40.634848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a5236327-826e-484f-adab-1451dc1f9afd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:40.635762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a5236327-826e-484f-adab-1451dc1f9afd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:40.642124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5236327-826e-484f-adab-1451dc1f9afd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:40.643062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5236327-826e-484f-adab-1451dc1f9afd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:40.643846 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5236327-826e-484f-adab-1451dc1f9afd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:40.644302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5236327-826e-484f-adab-1451dc1f9afd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:40.672495 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a5236327-826e-484f-adab-1451dc1f9afd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Jul 19 12:36:40.673036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 243/481] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:41.449943 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:41.450484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:41.457202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:41.457681 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:41.458446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:41.458887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:41.518916 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:41.526362 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e36a77b1-ed20-4559-8eac-9daf75b98541 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080303 Jul 19 12:36:41.526924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 239/482] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:41 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:41.683962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-658140ef-9207-4484-a43c-25b97ba2948a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:41.684950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-658140ef-9207-4484-a43c-25b97ba2948a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:41.691997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-658140ef-9207-4484-a43c-25b97ba2948a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:41.692486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-658140ef-9207-4484-a43c-25b97ba2948a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:41.693262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-658140ef-9207-4484-a43c-25b97ba2948a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:41.693707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-658140ef-9207-4484-a43c-25b97ba2948a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:41.722181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-658140ef-9207-4484-a43c-25b97ba2948a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Jul 19 12:36:41.722669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 244/483] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:42.542720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:42.543330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:42.550415 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:42.550862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:42.551623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:42.552060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:42.613873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:42.621391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3db05a9a-64a9-4b2e-9d9c-97c3e2f43ba8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082541 Jul 19 12:36:42.621951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 240/484] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:42 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:42.732509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2afe14a6-3f3f-42fd-8543-c56388463c64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:42.733473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2afe14a6-3f3f-42fd-8543-c56388463c64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:42.740694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2afe14a6-3f3f-42fd-8543-c56388463c64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:42.741148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2afe14a6-3f3f-42fd-8543-c56388463c64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:42.741970 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2afe14a6-3f3f-42fd-8543-c56388463c64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:42.742405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2afe14a6-3f3f-42fd-8543-c56388463c64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:42.770402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2afe14a6-3f3f-42fd-8543-c56388463c64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041846 Jul 19 12:36:42.770942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 245/485] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:43.637919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:43.638535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:43.645120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:43.645581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:43.646349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:43.646791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:43.706514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:43.714144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce4959c7-fc5b-4ae2-8469-95e2afec0ad6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079986 Jul 19 12:36:43.714731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 241/486] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:43 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:43.781798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-aed7038b-882e-4166-8ea2-a10a18c45dc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:43.782751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-aed7038b-882e-4166-8ea2-a10a18c45dc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:43.789258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed7038b-882e-4166-8ea2-a10a18c45dc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:43.789713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed7038b-882e-4166-8ea2-a10a18c45dc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:43.790473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed7038b-882e-4166-8ea2-a10a18c45dc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:43.790910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed7038b-882e-4166-8ea2-a10a18c45dc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:43.820515 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-aed7038b-882e-4166-8ea2-a10a18c45dc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jul 19 12:36:43.821080 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 246/487] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:44.730162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:44.730772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:44.737218 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:44.737669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:44.738428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:44.738864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:44.801706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:44.809171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50bd86dd-e4ca-43b8-8d59-c617d89b8e54 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082903 Jul 19 12:36:44.809728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 242/488] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:44 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:44.831979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0e7f8596-eee6-4d33-99b7-2b61ec7f1870 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:44.832927 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0e7f8596-eee6-4d33-99b7-2b61ec7f1870 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:44.839377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e7f8596-eee6-4d33-99b7-2b61ec7f1870 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:44.839830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e7f8596-eee6-4d33-99b7-2b61ec7f1870 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:44.840630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e7f8596-eee6-4d33-99b7-2b61ec7f1870 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:44.841072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e7f8596-eee6-4d33-99b7-2b61ec7f1870 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:44.868796 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0e7f8596-eee6-4d33-99b7-2b61ec7f1870 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Jul 19 12:36:44.869252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 247/489] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:45.826055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:45.826666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:45.833955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:45.834410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:45.835175 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:45.835613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:45.880513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4ce40c97-50fc-4bc0-bcb6-e46ac0a7458f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:45.881368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4ce40c97-50fc-4bc0-bcb6-e46ac0a7458f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:45.887995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ce40c97-50fc-4bc0-bcb6-e46ac0a7458f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:45.888493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ce40c97-50fc-4bc0-bcb6-e46ac0a7458f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:45.889265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ce40c97-50fc-4bc0-bcb6-e46ac0a7458f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:45.889708 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ce40c97-50fc-4bc0-bcb6-e46ac0a7458f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:45.896948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:45.904428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f97800ea-845f-40b3-aeef-2e107747343d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082172 Jul 19 12:36:45.905321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 243/490] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:45 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:45.925133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4ce40c97-50fc-4bc0-bcb6-e46ac0a7458f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048713 Jul 19 12:36:45.925687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 248/491] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:36:46.921410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:46.922017 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:46.928984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:46.929426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:46.930177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:46.930612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:46.936658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b28eef40-f992-4a31-a244-21c95fce29c6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:46.937577 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b28eef40-f992-4a31-a244-21c95fce29c6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:46.944611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b28eef40-f992-4a31-a244-21c95fce29c6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:46.945062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b28eef40-f992-4a31-a244-21c95fce29c6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:46.945827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b28eef40-f992-4a31-a244-21c95fce29c6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:46.946345 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b28eef40-f992-4a31-a244-21c95fce29c6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:46.975400 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b28eef40-f992-4a31-a244-21c95fce29c6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042609 Jul 19 12:36:46.975957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 249/492] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:36:46.992090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:46.999859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5dd4d619-1611-46cf-b1fe-d090fc0084f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082073 Jul 19 12:36:47.000431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 244/493] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:46 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:47.986773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0ea4ac63-43d7-46ca-861e-ac19e937bbd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:47.987686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0ea4ac63-43d7-46ca-861e-ac19e937bbd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:47.994320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ea4ac63-43d7-46ca-861e-ac19e937bbd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:47.994776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ea4ac63-43d7-46ca-861e-ac19e937bbd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:47.995543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ea4ac63-43d7-46ca-861e-ac19e937bbd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:47.995985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ea4ac63-43d7-46ca-861e-ac19e937bbd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:48.016270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:48.016839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:48.023781 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:48.024263 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:48.025026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:48.025469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:48.025689 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0ea4ac63-43d7-46ca-861e-ac19e937bbd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042763 Jul 19 12:36:48.026253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 250/494] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:48.085631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:48.095058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-539e1c85-191b-4d8d-a331-7f79f61032a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082711 Jul 19 12:36:48.095661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 245/495] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:48 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:36:49.037963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c622f1a8-a2f4-4b66-8696-ae2de8903168 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:49.038884 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c622f1a8-a2f4-4b66-8696-ae2de8903168 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:49.045299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c622f1a8-a2f4-4b66-8696-ae2de8903168 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:49.045754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c622f1a8-a2f4-4b66-8696-ae2de8903168 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:49.046511 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c622f1a8-a2f4-4b66-8696-ae2de8903168 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:49.046950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c622f1a8-a2f4-4b66-8696-ae2de8903168 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:49.074749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c622f1a8-a2f4-4b66-8696-ae2de8903168 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040702 Jul 19 12:36:49.075313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 251/496] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:49.111005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:49.111645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:49.118240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:49.118731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:49.119473 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:49.119967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:49.184736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:49.192622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f31b2701-0658-4249-a393-98945cbad8d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085543 Jul 19 12:36:49.193181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 246/497] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:49 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:50.086798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5ef7fb98-815c-4750-974f-42f962118df4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:50.087734 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5ef7fb98-815c-4750-974f-42f962118df4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:50.094320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ef7fb98-815c-4750-974f-42f962118df4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:50.094778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ef7fb98-815c-4750-974f-42f962118df4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:50.096072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ef7fb98-815c-4750-974f-42f962118df4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:50.096546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ef7fb98-815c-4750-974f-42f962118df4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:50.125523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5ef7fb98-815c-4750-974f-42f962118df4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042657 Jul 19 12:36:50.126082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 252/498] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:50.208919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:50.209525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:50.215930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:50.216415 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:50.217179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:50.217615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:50.278798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:50.286930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a273f5e-7cd9-4878-9c09-3150f005a496 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081800 Jul 19 12:36:50.287491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 247/499] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:50 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:51.137055 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-12bc8106-9082-4649-a9f0-7d7bd2e00083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:51.138066 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-12bc8106-9082-4649-a9f0-7d7bd2e00083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:51.140430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=60 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:51.145815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12bc8106-9082-4649-a9f0-7d7bd2e00083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:51.146276 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12bc8106-9082-4649-a9f0-7d7bd2e00083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:51.147049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12bc8106-9082-4649-a9f0-7d7bd2e00083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:51.147493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12bc8106-9082-4649-a9f0-7d7bd2e00083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:51.176047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-12bc8106-9082-4649-a9f0-7d7bd2e00083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043039 Jul 19 12:36:51.176623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 253/500] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:36:51.303287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:51.303891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:51.306190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=56 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:51.311339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:51.311789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:51.312585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:51.313022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:51.375790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:51.384073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6661242e-1a22-45a0-8e3c-9362dcc12665 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084694 Jul 19 12:36:51.384678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 248/501] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:51 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:52.187029 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ac365c14-61a1-4e9e-b557-89c1e652e3e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:52.187982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ac365c14-61a1-4e9e-b557-89c1e652e3e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:52.194950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac365c14-61a1-4e9e-b557-89c1e652e3e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:52.195407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac365c14-61a1-4e9e-b557-89c1e652e3e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:52.196190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac365c14-61a1-4e9e-b557-89c1e652e3e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:52.196650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac365c14-61a1-4e9e-b557-89c1e652e3e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:52.221671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:52.226918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ac365c14-61a1-4e9e-b557-89c1e652e3e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Jul 19 12:36:52.227835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 254/502] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:52.400609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:52.401241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:52.407673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:52.408115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:52.408951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:52.409385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:52.469553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:52.476843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e340e9d8-d841-4c95-9db5-baca3c61a8b5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080148 Jul 19 12:36:52.477397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 249/503] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:52 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:53.239483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-713bd22c-b43c-46a6-b19e-1cd0ce478430 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:53.240457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-713bd22c-b43c-46a6-b19e-1cd0ce478430 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:53.246747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713bd22c-b43c-46a6-b19e-1cd0ce478430 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:53.247196 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713bd22c-b43c-46a6-b19e-1cd0ce478430 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:53.247949 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713bd22c-b43c-46a6-b19e-1cd0ce478430 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:53.248554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713bd22c-b43c-46a6-b19e-1cd0ce478430 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:53.276119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-713bd22c-b43c-46a6-b19e-1cd0ce478430 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041351 Jul 19 12:36:53.276681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 255/504] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:53.493600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:53.494118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:53.500885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:53.501340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:53.502101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:53.502541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:53.564399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:53.567834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:53.572628 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4f9e764-66fa-4ed1-b46d-29c56fc0e797 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083004 Jul 19 12:36:53.573187 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 250/505] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:53 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:54.287940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4c88693a-ffb0-46ee-8d47-f8fe508ae90a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:54.288877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4c88693a-ffb0-46ee-8d47-f8fe508ae90a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:54.295429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c88693a-ffb0-46ee-8d47-f8fe508ae90a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:54.295881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c88693a-ffb0-46ee-8d47-f8fe508ae90a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:54.296676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c88693a-ffb0-46ee-8d47-f8fe508ae90a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:54.297119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c88693a-ffb0-46ee-8d47-f8fe508ae90a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:54.326145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4c88693a-ffb0-46ee-8d47-f8fe508ae90a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042469 Jul 19 12:36:54.326700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 256/506] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:54.589541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:54.590063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:54.597301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:54.597753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:54.598512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:54.598945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:54.659186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:54.666652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-84904ae1-f57a-4f37-a843-4479c17f2771 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080999 Jul 19 12:36:54.667214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 251/507] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:54 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:55.337854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b6e74192-e631-402a-9512-7c33cee61709 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:55.338773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b6e74192-e631-402a-9512-7c33cee61709 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:55.345218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6e74192-e631-402a-9512-7c33cee61709 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:55.345691 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6e74192-e631-402a-9512-7c33cee61709 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:55.346482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6e74192-e631-402a-9512-7c33cee61709 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:55.346960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6e74192-e631-402a-9512-7c33cee61709 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:55.375218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b6e74192-e631-402a-9512-7c33cee61709 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041272 Jul 19 12:36:55.375759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 257/508] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:55.683188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:55.683800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:55.690880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:55.691326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:55.692084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:55.692551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:55.752235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:55.760216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-65e434e8-5df7-4787-8d1b-a72a287360bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080825 Jul 19 12:36:55.760784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 252/509] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:55 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:56.387307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3304bbb0-e70e-4daa-9bd1-848acc41504a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:56.388259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3304bbb0-e70e-4daa-9bd1-848acc41504a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:56.395187 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3304bbb0-e70e-4daa-9bd1-848acc41504a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:56.395641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3304bbb0-e70e-4daa-9bd1-848acc41504a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:56.396434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3304bbb0-e70e-4daa-9bd1-848acc41504a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:56.396876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3304bbb0-e70e-4daa-9bd1-848acc41504a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:56.428586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3304bbb0-e70e-4daa-9bd1-848acc41504a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Jul 19 12:36:56.429154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 258/510] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:56.776537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:56.777152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:56.783552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:56.784004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:56.784804 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:56.785243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:56.846865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:56.854253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fcf5e374-d4a4-45ae-a5de-1d56741277ef tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081548 Jul 19 12:36:56.854808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 253/511] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:56 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:57.440783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9899403b-28fb-4921-8a57-1bb864a638cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:57.441701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9899403b-28fb-4921-8a57-1bb864a638cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:57.448121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9899403b-28fb-4921-8a57-1bb864a638cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:57.448604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9899403b-28fb-4921-8a57-1bb864a638cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:57.449369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9899403b-28fb-4921-8a57-1bb864a638cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:57.449811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9899403b-28fb-4921-8a57-1bb864a638cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:57.478038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9899403b-28fb-4921-8a57-1bb864a638cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041812 Jul 19 12:36:57.478578 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 259/512] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:36:57.870511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:57.871118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:57.877806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:57.878262 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:57.879021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:57.879460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:57.941506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:57.948828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-157e7fae-6e04-4618-9df3-acbac9e41246 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082144 Jul 19 12:36:57.949386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 254/513] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:57 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:58.489313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6db91450-32e9-489f-83b9-b0e1ac0d2a19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:58.490253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6db91450-32e9-489f-83b9-b0e1ac0d2a19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:58.496627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6db91450-32e9-489f-83b9-b0e1ac0d2a19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:58.497076 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6db91450-32e9-489f-83b9-b0e1ac0d2a19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:58.497825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6db91450-32e9-489f-83b9-b0e1ac0d2a19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:58.498257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6db91450-32e9-489f-83b9-b0e1ac0d2a19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:58.526991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6db91450-32e9-489f-83b9-b0e1ac0d2a19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041593 Jul 19 12:36:58.527526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 260/514] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:36:58.966059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:58.966595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:58.973625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:58.974078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:58.974838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:58.975275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:59.034956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:36:59.042352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78a94420-f9d5-4f27-b903-d170e8432f7d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080173 Jul 19 12:36:59.042919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 255/515] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:36:58 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:36:59.539055 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-720ee73c-f3db-424d-9089-3a0cceb67f33 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:36:59.539997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-720ee73c-f3db-424d-9089-3a0cceb67f33 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:36:59.546473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-720ee73c-f3db-424d-9089-3a0cceb67f33 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:59.546926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-720ee73c-f3db-424d-9089-3a0cceb67f33 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:59.547686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-720ee73c-f3db-424d-9089-3a0cceb67f33 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:36:59.548128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-720ee73c-f3db-424d-9089-3a0cceb67f33 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:36:59.575644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-720ee73c-f3db-424d-9089-3a0cceb67f33 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040578 Jul 19 12:36:59.576212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 261/516] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:36:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:00.059456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:00.060071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:00.066460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:00.066956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:00.067718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:00.068165 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:00.128200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:00.135526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d46d2ac4-2fab-40c6-b35b-146f9038e5ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079953 Jul 19 12:37:00.136115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 256/517] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:00 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:00.587181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c96dad2b-b8b3-4068-b2de-ee871d3e9d84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:00.588097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c96dad2b-b8b3-4068-b2de-ee871d3e9d84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:00.594567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c96dad2b-b8b3-4068-b2de-ee871d3e9d84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:00.595016 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c96dad2b-b8b3-4068-b2de-ee871d3e9d84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:00.595768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c96dad2b-b8b3-4068-b2de-ee871d3e9d84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:00.596253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c96dad2b-b8b3-4068-b2de-ee871d3e9d84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:00.624506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c96dad2b-b8b3-4068-b2de-ee871d3e9d84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Jul 19 12:37:00.625059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 262/518] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:01.156533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:01.157138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:01.163676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:01.164122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:01.164927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:01.165358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:01.224463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:01.231951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-759ece2a-4e55-4cc1-8572-bd8fa53cf9c3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079425 Jul 19 12:37:01.232541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 257/519] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:01 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:01.636445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ed8b1ac0-4f60-4c57-8f59-e82e320716f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:01.637363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ed8b1ac0-4f60-4c57-8f59-e82e320716f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:01.643770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ac0-4f60-4c57-8f59-e82e320716f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:01.644249 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ac0-4f60-4c57-8f59-e82e320716f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:01.645015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ac0-4f60-4c57-8f59-e82e320716f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:01.645456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ac0-4f60-4c57-8f59-e82e320716f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:01.673201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ed8b1ac0-4f60-4c57-8f59-e82e320716f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Jul 19 12:37:01.673744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 263/520] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:02.247735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:02.248510 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:02.255472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:02.256015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:02.256867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:02.257368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:02.320859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:02.328285 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2676d89-3dd1-46fa-9b62-3f43fb9544db tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084455 Jul 19 12:37:02.328849 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 258/521] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:02 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:02.685046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3ed0414a-db50-494f-9719-eaa4d7b52a36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:02.685984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3ed0414a-db50-494f-9719-eaa4d7b52a36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:02.693409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ed0414a-db50-494f-9719-eaa4d7b52a36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:02.693866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ed0414a-db50-494f-9719-eaa4d7b52a36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:02.694675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ed0414a-db50-494f-9719-eaa4d7b52a36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:02.695114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ed0414a-db50-494f-9719-eaa4d7b52a36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:02.723940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3ed0414a-db50-494f-9719-eaa4d7b52a36 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 Jul 19 12:37:02.724538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 264/522] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:03.345007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:03.345612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:03.352091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:03.352580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:03.353334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:03.353766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:03.421338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:03.429358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-03190674-661c-4b17-8c30-cb4eee3c8236 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088238 Jul 19 12:37:03.429918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 259/523] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:03.735452 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e7096cc3-d830-45a7-9c0a-fab480c99268 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:03.736508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e7096cc3-d830-45a7-9c0a-fab480c99268 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:03.743591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7096cc3-d830-45a7-9c0a-fab480c99268 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:03.744042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7096cc3-d830-45a7-9c0a-fab480c99268 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:03.744841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7096cc3-d830-45a7-9c0a-fab480c99268 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:03.745277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7096cc3-d830-45a7-9c0a-fab480c99268 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:03.773429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e7096cc3-d830-45a7-9c0a-fab480c99268 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041915 Jul 19 12:37:03.773975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 265/524] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:04.447112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:04.447719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:04.454140 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:04.454588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:04.455346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:04.456469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:04.517581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:04.525730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56dcb4d5-71c5-4635-b78f-fb1ad8e78b58 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082570 Jul 19 12:37:04.526295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 260/525] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:04 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:04.784315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-43cfe33e-b23d-4db5-8dd2-c136f4e2aba0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:04.785233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-43cfe33e-b23d-4db5-8dd2-c136f4e2aba0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:04.791776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43cfe33e-b23d-4db5-8dd2-c136f4e2aba0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:04.792257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43cfe33e-b23d-4db5-8dd2-c136f4e2aba0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:04.793022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43cfe33e-b23d-4db5-8dd2-c136f4e2aba0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:04.793462 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43cfe33e-b23d-4db5-8dd2-c136f4e2aba0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:04.822124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-43cfe33e-b23d-4db5-8dd2-c136f4e2aba0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 Jul 19 12:37:04.822677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 266/526] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:05.542000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:05.542616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:05.549138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:05.550076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:05.550832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:05.551262 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:05.610363 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:05.618306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ed2e843e-5597-4646-b04e-7d7c1fbe3890 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080097 Jul 19 12:37:05.618868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 261/527] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:05 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:05.833595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ad8483e8-6793-4a65-aab5-94de4448d705 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:05.834451 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ad8483e8-6793-4a65-aab5-94de4448d705 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:05.840935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad8483e8-6793-4a65-aab5-94de4448d705 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:05.841392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad8483e8-6793-4a65-aab5-94de4448d705 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:05.842154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad8483e8-6793-4a65-aab5-94de4448d705 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:05.842597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad8483e8-6793-4a65-aab5-94de4448d705 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:05.871182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ad8483e8-6793-4a65-aab5-94de4448d705 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Jul 19 12:37:05.871721 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 267/528] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:06.634774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:06.635385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:06.642092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:06.642551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:06.644013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:06.644484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:06.707290 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:06.714704 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9e920ae-ef51-490c-97f7-68418de32507 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083795 Jul 19 12:37:06.715266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 262/529] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:06.882949 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-86e1d420-13c0-44a4-a1bd-d3c20fc00d58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:06.883827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-86e1d420-13c0-44a4-a1bd-d3c20fc00d58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:06.890306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86e1d420-13c0-44a4-a1bd-d3c20fc00d58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:06.890762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86e1d420-13c0-44a4-a1bd-d3c20fc00d58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:06.891522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86e1d420-13c0-44a4-a1bd-d3c20fc00d58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:06.891956 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86e1d420-13c0-44a4-a1bd-d3c20fc00d58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:06.920740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-86e1d420-13c0-44a4-a1bd-d3c20fc00d58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Jul 19 12:37:06.921287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 268/530] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:07.730772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:07.731374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:07.738391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:07.738837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:07.739591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:07.740024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:07.800027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:07.807404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-84e57607-100f-44a9-aab0-578beecc1ddb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080518 Jul 19 12:37:07.807961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 263/531] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:07.932039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4104d472-1450-4eac-a32d-3814de9e7616 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:07.932990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4104d472-1450-4eac-a32d-3814de9e7616 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:07.939632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4104d472-1450-4eac-a32d-3814de9e7616 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:07.940113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4104d472-1450-4eac-a32d-3814de9e7616 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:07.940916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4104d472-1450-4eac-a32d-3814de9e7616 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:07.941407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4104d472-1450-4eac-a32d-3814de9e7616 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:07.969687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4104d472-1450-4eac-a32d-3814de9e7616 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041531 Jul 19 12:37:07.970266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 269/532] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:08.824339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:08.824962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:08.832034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:08.832515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:08.833285 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:08.833723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:08.893731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:08.901121 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ef1b1845-5a98-4b96-b6da-d0b9e97b2422 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080680 Jul 19 12:37:08.901692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 264/533] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:08 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:08.981857 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4a54a474-83cb-4de3-8131-16b92725c97b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:08.982769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4a54a474-83cb-4de3-8131-16b92725c97b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:08.989305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a54a474-83cb-4de3-8131-16b92725c97b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:08.989756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a54a474-83cb-4de3-8131-16b92725c97b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:08.990510 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a54a474-83cb-4de3-8131-16b92725c97b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:08.990946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a54a474-83cb-4de3-8131-16b92725c97b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:09.022072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4a54a474-83cb-4de3-8131-16b92725c97b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043454 Jul 19 12:37:09.022824 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 270/534] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:09.917684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:09.918299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:09.924755 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:09.925207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:09.925974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:09.926415 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:09.987312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:09.994726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b950bf1b-8a8d-41d4-86c2-56a646b00d7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080975 Jul 19 12:37:09.995289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 265/535] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:09 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:10.034818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2882b6b9-8448-432b-8b22-8aabb4a107a6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:10.035731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2882b6b9-8448-432b-8b22-8aabb4a107a6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:10.042053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2882b6b9-8448-432b-8b22-8aabb4a107a6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:10.042503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2882b6b9-8448-432b-8b22-8aabb4a107a6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:10.043255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2882b6b9-8448-432b-8b22-8aabb4a107a6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:10.043694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2882b6b9-8448-432b-8b22-8aabb4a107a6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:10.060441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:10.073294 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2882b6b9-8448-432b-8b22-8aabb4a107a6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043357 Jul 19 12:37:10.073846 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 271/536] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:37:11.011260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:11.011873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:11.018998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:11.019448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:11.020236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:11.020678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:11.082743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:11.085779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c70d9c91-e6fb-4cb5-a679-675cc8f59349 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:11.086696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c70d9c91-e6fb-4cb5-a679-675cc8f59349 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:11.090246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dd825616-9e0b-4323-855f-19010c697b67 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082873 Jul 19 12:37:11.090821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 266/537] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:11 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:11.093122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c70d9c91-e6fb-4cb5-a679-675cc8f59349 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:11.093571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c70d9c91-e6fb-4cb5-a679-675cc8f59349 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:11.094330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c70d9c91-e6fb-4cb5-a679-675cc8f59349 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:11.094768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c70d9c91-e6fb-4cb5-a679-675cc8f59349 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:11.123564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c70d9c91-e6fb-4cb5-a679-675cc8f59349 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041587 Jul 19 12:37:11.124121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 272/538] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:37:12.106804 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:12.107416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:12.114506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:12.114955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:12.115717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:12.116161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:12.135719 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-20e434c0-75d6-4032-b3cd-a551a3ef5731 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:12.137379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-20e434c0-75d6-4032-b3cd-a551a3ef5731 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:12.139420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:12.145314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-20e434c0-75d6-4032-b3cd-a551a3ef5731 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:12.145876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-20e434c0-75d6-4032-b3cd-a551a3ef5731 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:12.146950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-20e434c0-75d6-4032-b3cd-a551a3ef5731 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:12.147400 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-20e434c0-75d6-4032-b3cd-a551a3ef5731 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:12.176798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-20e434c0-75d6-4032-b3cd-a551a3ef5731 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Jul 19 12:37:12.177559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 273/539] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:37:12.180196 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:12.187694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ffc0099-7c5b-4c00-a463-5efa2920fe98 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084752 Jul 19 12:37:12.188264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 267/540] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:12 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:37:13.188353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-34b8eafc-d43e-4cba-a3ec-49a60ac39b7f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:13.189282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-34b8eafc-d43e-4cba-a3ec-49a60ac39b7f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:13.195663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-34b8eafc-d43e-4cba-a3ec-49a60ac39b7f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:13.196116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-34b8eafc-d43e-4cba-a3ec-49a60ac39b7f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:13.196908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-34b8eafc-d43e-4cba-a3ec-49a60ac39b7f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:13.197347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-34b8eafc-d43e-4cba-a3ec-49a60ac39b7f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:13.204404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:13.205014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:13.211580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:13.212040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:13.212873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:13.213334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:13.226382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-34b8eafc-d43e-4cba-a3ec-49a60ac39b7f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041940 Jul 19 12:37:13.226945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 274/541] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:13.273751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:13.280980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4da54a82-c564-4166-8394-dcb941efaeb8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080369 Jul 19 12:37:13.281544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 268/542] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:37:14.238006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-24606f3d-6f29-4ff8-8e64-294c6219c29c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:14.238932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-24606f3d-6f29-4ff8-8e64-294c6219c29c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:14.245336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24606f3d-6f29-4ff8-8e64-294c6219c29c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:14.245792 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24606f3d-6f29-4ff8-8e64-294c6219c29c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:14.246554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24606f3d-6f29-4ff8-8e64-294c6219c29c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:14.246992 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24606f3d-6f29-4ff8-8e64-294c6219c29c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:14.276439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-24606f3d-6f29-4ff8-8e64-294c6219c29c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 Jul 19 12:37:14.276982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 275/543] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:14.297838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:14.298379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:14.305492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:14.305940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:14.306708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:14.307170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:14.367119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:14.374733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6d71e7e-2ab4-4154-84c7-a1e5759c88cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080621 Jul 19 12:37:14.375297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 269/544] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:15.288422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f4e29eeb-3e33-4d0d-bde9-a45d572b1e2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:15.289338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f4e29eeb-3e33-4d0d-bde9-a45d572b1e2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:15.295830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4e29eeb-3e33-4d0d-bde9-a45d572b1e2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:15.296312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4e29eeb-3e33-4d0d-bde9-a45d572b1e2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:15.297075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4e29eeb-3e33-4d0d-bde9-a45d572b1e2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:15.297513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4e29eeb-3e33-4d0d-bde9-a45d572b1e2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:15.325293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f4e29eeb-3e33-4d0d-bde9-a45d572b1e2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041412 Jul 19 12:37:15.325844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 276/545] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:15.390632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:15.391244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:15.398266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:15.398716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:15.399477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:15.399912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:15.463120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:15.470534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fda2989a-0048-4c62-b7ea-f6b4d5d76c80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083684 Jul 19 12:37:15.471096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 270/546] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:15 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:16.337804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6b49dec4-b5ed-408b-9bad-1fd72102bdc6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:16.338721 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6b49dec4-b5ed-408b-9bad-1fd72102bdc6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:16.344970 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b49dec4-b5ed-408b-9bad-1fd72102bdc6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:16.345426 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b49dec4-b5ed-408b-9bad-1fd72102bdc6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:16.346700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b49dec4-b5ed-408b-9bad-1fd72102bdc6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:16.347138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b49dec4-b5ed-408b-9bad-1fd72102bdc6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:16.378024 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6b49dec4-b5ed-408b-9bad-1fd72102bdc6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Jul 19 12:37:16.378587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 277/547] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:16.487402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:16.488041 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:16.495012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:16.495493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:16.496286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:16.496728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:16.556830 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:16.564280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ed5c9add-e591-4ef4-aa51-ca29c8f1df5f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081310 Jul 19 12:37:16.564839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 271/548] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:16 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:17.389563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e02ac7db-3380-4af8-adf2-b7a2054c4553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:17.390476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e02ac7db-3380-4af8-adf2-b7a2054c4553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:17.396965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e02ac7db-3380-4af8-adf2-b7a2054c4553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:17.397417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e02ac7db-3380-4af8-adf2-b7a2054c4553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:17.398174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e02ac7db-3380-4af8-adf2-b7a2054c4553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:17.398608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e02ac7db-3380-4af8-adf2-b7a2054c4553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:17.426759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e02ac7db-3380-4af8-adf2-b7a2054c4553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041197 Jul 19 12:37:17.427299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 278/549] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:17.581459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:17.582105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:17.588479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:17.588925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:17.589682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:17.590116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:17.650326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:17.657699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d9432c3-6559-476c-a9e2-7187eebb37fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080052 Jul 19 12:37:17.658860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 272/550] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:18.438335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2af63487-a0c0-4007-bc0f-e63d60dbc60d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:18.439267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2af63487-a0c0-4007-bc0f-e63d60dbc60d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:18.446203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2af63487-a0c0-4007-bc0f-e63d60dbc60d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:18.446659 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2af63487-a0c0-4007-bc0f-e63d60dbc60d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:18.447424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2af63487-a0c0-4007-bc0f-e63d60dbc60d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:18.447885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2af63487-a0c0-4007-bc0f-e63d60dbc60d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:18.476703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2af63487-a0c0-4007-bc0f-e63d60dbc60d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Jul 19 12:37:18.477270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 279/551] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:18.675204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:18.675811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:18.682418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:18.682867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:18.683621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:18.684052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:18.748832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:18.756757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba459759-0c38-44f3-b96a-0eb945dca8a7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085969 Jul 19 12:37:18.757320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 273/552] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:19.488199 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7536aecf-e086-4e8e-b738-7e6356835c35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:19.489199 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7536aecf-e086-4e8e-b738-7e6356835c35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:19.495531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7536aecf-e086-4e8e-b738-7e6356835c35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:19.495978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7536aecf-e086-4e8e-b738-7e6356835c35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:19.496759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7536aecf-e086-4e8e-b738-7e6356835c35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:19.497194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7536aecf-e086-4e8e-b738-7e6356835c35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:19.526160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7536aecf-e086-4e8e-b738-7e6356835c35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 Jul 19 12:37:19.526702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 280/553] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:19.773361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:19.773985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:19.783105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:19.783552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:19.785181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:19.785617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:19.847689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:19.855072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41fe3713-3e59-4083-aece-8ee2bad74e4b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085526 Jul 19 12:37:19.855623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 274/554] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:20.538120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f9d95240-f688-4dc6-9ae0-07794cd93d14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:20.539032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f9d95240-f688-4dc6-9ae0-07794cd93d14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:20.545422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9d95240-f688-4dc6-9ae0-07794cd93d14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:20.545867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9d95240-f688-4dc6-9ae0-07794cd93d14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:20.546618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9d95240-f688-4dc6-9ae0-07794cd93d14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:20.547053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9d95240-f688-4dc6-9ae0-07794cd93d14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:20.574990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f9d95240-f688-4dc6-9ae0-07794cd93d14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Jul 19 12:37:20.575531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 281/555] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:20.871775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:20.872340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:20.879545 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:20.879993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:20.880783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:20.881219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:20.940935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:20.948571 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ebd09ea-5559-42a8-a873-796999e8489e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080695 Jul 19 12:37:20.949132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 275/556] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:21.587049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-55e1166e-0ce2-4d66-8625-c1067f0ac573 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:21.587964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-55e1166e-0ce2-4d66-8625-c1067f0ac573 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:21.590262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=58 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:21.595528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-55e1166e-0ce2-4d66-8625-c1067f0ac573 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:21.596396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-55e1166e-0ce2-4d66-8625-c1067f0ac573 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:21.597164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-55e1166e-0ce2-4d66-8625-c1067f0ac573 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:21.597606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-55e1166e-0ce2-4d66-8625-c1067f0ac573 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:21.627731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-55e1166e-0ce2-4d66-8625-c1067f0ac573 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Jul 19 12:37:21.628332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 282/557] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:21.965564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:21.966081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:21.968442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=56 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:21.974247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:21.974697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:21.975456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:21.975889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:22.037949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:22.045331 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-559c5c9d-8fef-42df-b5c6-88ed76695957 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083631 Jul 19 12:37:22.045886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 276/558] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:22.639041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ae6240ac-2435-4298-b04b-377836c776fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:22.639951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ae6240ac-2435-4298-b04b-377836c776fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:22.646426 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6240ac-2435-4298-b04b-377836c776fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:22.646906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6240ac-2435-4298-b04b-377836c776fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:22.647658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6240ac-2435-4298-b04b-377836c776fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:22.648092 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ae6240ac-2435-4298-b04b-377836c776fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:22.676312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ae6240ac-2435-4298-b04b-377836c776fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041283 Jul 19 12:37:22.676860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 283/559] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:23.062118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:23.062738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:23.069267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:23.069731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:23.070503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:23.070991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:23.132987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:23.140345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0376da2e-1e9c-4737-ae22-f3bbc8f94e7e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082155 Jul 19 12:37:23.140911 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 277/560] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:23 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:23.686896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-73941b0b-6cd6-449c-bc13-a743ec7cfe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:23.687805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-73941b0b-6cd6-449c-bc13-a743ec7cfe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:23.694649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73941b0b-6cd6-449c-bc13-a743ec7cfe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:23.695096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73941b0b-6cd6-449c-bc13-a743ec7cfe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:23.695886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73941b0b-6cd6-449c-bc13-a743ec7cfe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:23.696414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73941b0b-6cd6-449c-bc13-a743ec7cfe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:23.724326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-73941b0b-6cd6-449c-bc13-a743ec7cfe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Jul 19 12:37:23.724866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 284/561] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:24.156228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:24.156842 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:24.163232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:24.163675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:24.164457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:24.164889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:24.226513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:24.233740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ac1b2861-1771-40fb-b00b-144206448167 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081324 Jul 19 12:37:24.234299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 278/562] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:24 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:24.735259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-705a7921-5813-42b8-b05a-6056fb9bc70a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:24.736823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-705a7921-5813-42b8-b05a-6056fb9bc70a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:24.743149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-705a7921-5813-42b8-b05a-6056fb9bc70a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:24.743598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-705a7921-5813-42b8-b05a-6056fb9bc70a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:24.744392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-705a7921-5813-42b8-b05a-6056fb9bc70a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:24.744828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-705a7921-5813-42b8-b05a-6056fb9bc70a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:24.772626 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-705a7921-5813-42b8-b05a-6056fb9bc70a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041645 Jul 19 12:37:24.773172 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 285/563] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:25.250506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:25.251142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:25.258001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:25.258647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:25.259410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:25.259844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:25.319264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:25.326792 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5643bf5e-37a3-4fde-9640-cbbaa76cfea5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080356 Jul 19 12:37:25.327359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 279/564] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:25 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:25.783630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8af4876b-1170-4b03-9167-ebea609398ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:25.784573 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8af4876b-1170-4b03-9167-ebea609398ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:25.791012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8af4876b-1170-4b03-9167-ebea609398ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:25.791456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8af4876b-1170-4b03-9167-ebea609398ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:25.792226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8af4876b-1170-4b03-9167-ebea609398ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:25.792663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8af4876b-1170-4b03-9167-ebea609398ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:25.823222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8af4876b-1170-4b03-9167-ebea609398ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Jul 19 12:37:25.823775 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 286/565] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:26.343304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:26.343911 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:26.351114 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:26.351561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:26.352365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:26.352800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:26.414602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:26.422224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-549c8580-d2e2-40b3-afd1-d0f3ec9dd812 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082810 Jul 19 12:37:26.422791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 280/566] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:26 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:26.837007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e77b419c-8804-42da-8c3b-572c20f6bb6a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:26.837918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e77b419c-8804-42da-8c3b-572c20f6bb6a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:26.844314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e77b419c-8804-42da-8c3b-572c20f6bb6a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:26.844765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e77b419c-8804-42da-8c3b-572c20f6bb6a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:26.845516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e77b419c-8804-42da-8c3b-572c20f6bb6a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:26.845950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e77b419c-8804-42da-8c3b-572c20f6bb6a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:26.873348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e77b419c-8804-42da-8c3b-572c20f6bb6a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040221 Jul 19 12:37:26.873824 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 287/567] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:27.438785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:27.439392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:27.445925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:27.446375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:27.447134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:27.447567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:27.507586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:27.514949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-65529783-82a7-4b08-a3d5-658f9325a283 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080009 Jul 19 12:37:27.515519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 281/568] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:27 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:27.885651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-26f1930a-517e-451e-919b-ea89723c495f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:27.886570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-26f1930a-517e-451e-919b-ea89723c495f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:27.893019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26f1930a-517e-451e-919b-ea89723c495f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:27.893470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26f1930a-517e-451e-919b-ea89723c495f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:27.894312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26f1930a-517e-451e-919b-ea89723c495f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:27.894753 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26f1930a-517e-451e-919b-ea89723c495f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:27.898257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:27.922754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-26f1930a-517e-451e-919b-ea89723c495f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Jul 19 12:37:27.923290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 288/569] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:28.531476 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:28.532091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:28.538571 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:28.539032 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:28.539803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:28.540275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:28.602442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:28.609967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-976c5686-3c5a-4f95-87b6-dfa5ada2cd80 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082307 Jul 19 12:37:28.610548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 282/570] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:28 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:28.934763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5adab704-5aa4-40dc-a31c-e032b7f832ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:28.935598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5adab704-5aa4-40dc-a31c-e032b7f832ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:28.941975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5adab704-5aa4-40dc-a31c-e032b7f832ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:28.942425 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5adab704-5aa4-40dc-a31c-e032b7f832ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:28.943181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5adab704-5aa4-40dc-a31c-e032b7f832ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:28.943618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5adab704-5aa4-40dc-a31c-e032b7f832ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:28.971497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5adab704-5aa4-40dc-a31c-e032b7f832ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040783 Jul 19 12:37:28.972038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 289/571] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:29.627101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:29.627884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:29.634220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:29.634746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:29.635589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:29.636099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:29.701236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:29.709380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-401ec270-09e4-4d63-9da3-9da5a29ef0a0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.086389 Jul 19 12:37:29.709946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 283/572] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:29 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:29.982881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8ea92352-43bd-47b6-b7a4-b0751584069b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:29.983803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8ea92352-43bd-47b6-b7a4-b0751584069b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:29.990311 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea92352-43bd-47b6-b7a4-b0751584069b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:29.990761 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea92352-43bd-47b6-b7a4-b0751584069b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:29.991515 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea92352-43bd-47b6-b7a4-b0751584069b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:29.991950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8ea92352-43bd-47b6-b7a4-b0751584069b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:30.020874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8ea92352-43bd-47b6-b7a4-b0751584069b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041901 Jul 19 12:37:30.021423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 290/573] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:30.725767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:30.726380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:30.733024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:30.733474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:30.734238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:30.734673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:30.738601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:30.795635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:30.803938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0eec702e-5143-4883-b5d9-7fafbb6a92be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081959 Jul 19 12:37:30.804542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 284/574] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:30 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:31.033517 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-51770285-206e-4d81-b1c7-f31b9d8713a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:31.034460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-51770285-206e-4d81-b1c7-f31b9d8713a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:31.041005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51770285-206e-4d81-b1c7-f31b9d8713a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:31.041464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51770285-206e-4d81-b1c7-f31b9d8713a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:31.042235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51770285-206e-4d81-b1c7-f31b9d8713a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:31.042681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51770285-206e-4d81-b1c7-f31b9d8713a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:31.072200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-51770285-206e-4d81-b1c7-f31b9d8713a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Jul 19 12:37:31.072762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 291/575] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:31.820900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:31.821538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:31.827678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:31.828112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:31.828909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:31.829352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:31.888893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:31.896217 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab601b90-6207-44c1-a97f-28817d539e62 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079109 Jul 19 12:37:31.896786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 285/576] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:31 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:32.083910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-74597ba8-cf74-4480-baf2-722de3e0ec4f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:32.084851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-74597ba8-cf74-4480-baf2-722de3e0ec4f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:32.090768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-74597ba8-cf74-4480-baf2-722de3e0ec4f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:32.091228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-74597ba8-cf74-4480-baf2-722de3e0ec4f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:32.091982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-74597ba8-cf74-4480-baf2-722de3e0ec4f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:32.092449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-74597ba8-cf74-4480-baf2-722de3e0ec4f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:32.119815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-74597ba8-cf74-4480-baf2-722de3e0ec4f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040614 Jul 19 12:37:32.120396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 292/577] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:32.913155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:32.913677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:32.920110 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:32.920590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:32.921351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:32.921786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:32.984567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:32.992656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41b5f188-6998-4a48-9b2c-b0cf2c838142 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083370 Jul 19 12:37:32.993219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 286/578] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:32 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:33.131092 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6c814356-c3b2-4409-8d3b-90d83ec67444 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:33.132015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6c814356-c3b2-4409-8d3b-90d83ec67444 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:33.138470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c814356-c3b2-4409-8d3b-90d83ec67444 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:33.138918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c814356-c3b2-4409-8d3b-90d83ec67444 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:33.139676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c814356-c3b2-4409-8d3b-90d83ec67444 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:33.140111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c814356-c3b2-4409-8d3b-90d83ec67444 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:33.169214 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6c814356-c3b2-4409-8d3b-90d83ec67444 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041983 Jul 19 12:37:33.169693 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 293/579] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:34.008547 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:34.009159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:34.015659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:34.016106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:34.016900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:34.017338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:34.081241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:34.088835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c82d033-2a76-4f96-90d6-32dd7793800c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084118 Jul 19 12:37:34.089436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 287/580] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:34 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:34.181109 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-37a01e74-cae1-4639-a240-5bb2853de5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:34.182021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-37a01e74-cae1-4639-a240-5bb2853de5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:34.188480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37a01e74-cae1-4639-a240-5bb2853de5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:34.188931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37a01e74-cae1-4639-a240-5bb2853de5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:34.189685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37a01e74-cae1-4639-a240-5bb2853de5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:34.190119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-37a01e74-cae1-4639-a240-5bb2853de5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:34.218242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-37a01e74-cae1-4639-a240-5bb2853de5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041073 Jul 19 12:37:34.218783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 294/581] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:35.106779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:35.107390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:35.113943 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:35.114402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:35.115170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:35.115610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:35.176362 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:35.183972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b9b32ab-2a64-4ee1-a17e-c2c350d40a09 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081933 Jul 19 12:37:35.184573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 288/582] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:35 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:37:35.282350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e048ff1a-7c31-4f8d-a289-3912efa35faa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:35.283344 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e048ff1a-7c31-4f8d-a289-3912efa35faa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:35.289403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e048ff1a-7c31-4f8d-a289-3912efa35faa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:35.289860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e048ff1a-7c31-4f8d-a289-3912efa35faa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:35.290620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e048ff1a-7c31-4f8d-a289-3912efa35faa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:35.291058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e048ff1a-7c31-4f8d-a289-3912efa35faa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:35.319839 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e048ff1a-7c31-4f8d-a289-3912efa35faa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093775 Jul 19 12:37:35.320419 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 295/583] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:36.201319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:36.201923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:36.208377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:36.208822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:36.209576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:36.210004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:36.269845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:36.277184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-446a8a76-b621-42b5-bfe3-e36239fd9e07 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079705 Jul 19 12:37:36.277703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 289/584] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:36 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:36.331415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-41a1b955-8f9c-4cb2-a9af-cd2f5b430e2a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:36.332385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-41a1b955-8f9c-4cb2-a9af-cd2f5b430e2a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:36.338863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b955-8f9c-4cb2-a9af-cd2f5b430e2a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:36.339318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b955-8f9c-4cb2-a9af-cd2f5b430e2a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:36.340081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b955-8f9c-4cb2-a9af-cd2f5b430e2a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:36.340545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b955-8f9c-4cb2-a9af-cd2f5b430e2a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:36.369363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-41a1b955-8f9c-4cb2-a9af-cd2f5b430e2a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041945 Jul 19 12:37:36.369941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 296/585] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:37.293671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:37.294302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:37.301289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:37.301736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:37.302488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:37.302919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:37.365484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:37.372949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-747e48cd-4141-4bae-9729-c6d2e34959f4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083127 Jul 19 12:37:37.373512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 290/586] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:37 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:37.380695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c7200024-d8f1-4cae-8387-03c05508e12f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:37.381621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c7200024-d8f1-4cae-8387-03c05508e12f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:37.387939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7200024-d8f1-4cae-8387-03c05508e12f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:37.388428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7200024-d8f1-4cae-8387-03c05508e12f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:37.389193 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7200024-d8f1-4cae-8387-03c05508e12f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:37.389629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7200024-d8f1-4cae-8387-03c05508e12f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:37.417913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c7200024-d8f1-4cae-8387-03c05508e12f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Jul 19 12:37:37.418451 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 297/587] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:38.389689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:38.390297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:38.396913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:38.397361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:38.398122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:38.398556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:38.429785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7ce41e8f-0875-419d-8ef9-62146a47f02f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:38.430763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7ce41e8f-0875-419d-8ef9-62146a47f02f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:38.437236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ce41e8f-0875-419d-8ef9-62146a47f02f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:38.437719 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ce41e8f-0875-419d-8ef9-62146a47f02f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:38.438505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ce41e8f-0875-419d-8ef9-62146a47f02f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:38.439540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7ce41e8f-0875-419d-8ef9-62146a47f02f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:38.458719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:38.466162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c126cb6c-d294-4523-a388-cf1901343b57 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080374 Jul 19 12:37:38.466727 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 291/588] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:38 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:38.468797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7ce41e8f-0875-419d-8ef9-62146a47f02f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Jul 19 12:37:38.469353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 298/589] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:37:39.480069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8edb70ce-8484-46cf-97d9-094b27587fc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:39.481076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8edb70ce-8484-46cf-97d9-094b27587fc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:39.482261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:39.482880 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:39.487495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8edb70ce-8484-46cf-97d9-094b27587fc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:39.487946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8edb70ce-8484-46cf-97d9-094b27587fc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:39.488732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8edb70ce-8484-46cf-97d9-094b27587fc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:39.489165 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8edb70ce-8484-46cf-97d9-094b27587fc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:39.489326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:39.489789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:39.490557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:39.491007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:39.518237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8edb70ce-8484-46cf-97d9-094b27587fc2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 Jul 19 12:37:39.518791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 292/590] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:39.551950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:39.559377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b400858b-7399-475e-884c-adf27617411d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080941 Jul 19 12:37:39.559952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 299/591] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:39 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:37:40.529932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ccce8300-199d-4562-9c64-dfb050d0d0d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:40.530852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ccce8300-199d-4562-9c64-dfb050d0d0d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:40.537783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccce8300-199d-4562-9c64-dfb050d0d0d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:40.538238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccce8300-199d-4562-9c64-dfb050d0d0d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:40.538998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccce8300-199d-4562-9c64-dfb050d0d0d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:40.539444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccce8300-199d-4562-9c64-dfb050d0d0d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:40.567766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ccce8300-199d-4562-9c64-dfb050d0d0d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041796 Jul 19 12:37:40.568331 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 293/592] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:40.576080 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:40.576725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:40.583656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:40.584112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:40.584924 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:40.585369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:40.645739 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:40.653161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0afcf14a-cccd-46d2-b6fa-4850166f694f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080871 Jul 19 12:37:40.653724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 300/593] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:40 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:41.578722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dbe42652-fd05-4580-b957-34bae698d64c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:41.580165 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dbe42652-fd05-4580-b957-34bae698d64c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:41.586520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbe42652-fd05-4580-b957-34bae698d64c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:41.586965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbe42652-fd05-4580-b957-34bae698d64c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:41.587715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbe42652-fd05-4580-b957-34bae698d64c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:41.588148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbe42652-fd05-4580-b957-34bae698d64c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:41.616876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dbe42652-fd05-4580-b957-34bae698d64c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Jul 19 12:37:41.617456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 294/594] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:41.670096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:41.670735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:41.677163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:41.677905 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:41.678678 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:41.679119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:41.741633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:41.749035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4192b019-4f8d-4e2b-a7e8-b4303496ad8d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082752 Jul 19 12:37:41.749855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 301/595] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:41 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:42.629089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-caab4d01-4bb2-437d-8439-c063596405fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:42.630007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-caab4d01-4bb2-437d-8439-c063596405fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:42.636392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-caab4d01-4bb2-437d-8439-c063596405fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:42.636848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-caab4d01-4bb2-437d-8439-c063596405fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:42.637600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-caab4d01-4bb2-437d-8439-c063596405fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:42.638031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-caab4d01-4bb2-437d-8439-c063596405fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:42.667947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-caab4d01-4bb2-437d-8439-c063596405fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043549 Jul 19 12:37:42.668543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 295/596] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:42.767399 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:42.768008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:42.774323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:42.774768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:42.775522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:42.775956 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:42.837576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:42.844889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f376c655-a42e-48e8-9ed4-002872c9284e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081983 Jul 19 12:37:42.845450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 302/597] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:42 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:43.678987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b0c401c8-b1e4-410d-be0f-95697c7683a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:43.679934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b0c401c8-b1e4-410d-be0f-95697c7683a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:43.686499 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0c401c8-b1e4-410d-be0f-95697c7683a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:43.686946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0c401c8-b1e4-410d-be0f-95697c7683a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:43.687714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0c401c8-b1e4-410d-be0f-95697c7683a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:43.688155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0c401c8-b1e4-410d-be0f-95697c7683a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:43.716668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b0c401c8-b1e4-410d-be0f-95697c7683a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041502 Jul 19 12:37:43.717229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 296/598] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:43.861828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:43.862466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:43.869008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:43.869408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:43.870170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:43.870610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:43.929912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:43.937273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dd846e06-ab95-43c6-9ddd-1433c24a7393 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079369 Jul 19 12:37:43.937840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 303/599] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:43 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:44.728359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc0ca6e6-5ad5-4f16-b44c-c08a5e68617b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:44.729278 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc0ca6e6-5ad5-4f16-b44c-c08a5e68617b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:44.736395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc0ca6e6-5ad5-4f16-b44c-c08a5e68617b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:44.736847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc0ca6e6-5ad5-4f16-b44c-c08a5e68617b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:44.737604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc0ca6e6-5ad5-4f16-b44c-c08a5e68617b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:44.738041 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc0ca6e6-5ad5-4f16-b44c-c08a5e68617b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:44.766891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc0ca6e6-5ad5-4f16-b44c-c08a5e68617b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042521 Jul 19 12:37:44.767439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 297/600] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:44.954283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:44.954808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:44.961284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:44.961738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:44.962504 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:44.962941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:45.022593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:45.025918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:45.030649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8dfc227b-4da6-4b02-bec6-3d7fd13c0cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080278 Jul 19 12:37:45.031212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 304/601] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:44 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:45.778521 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa018582-3a6d-46e1-9cdf-3fafdd744e20 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:45.779431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa018582-3a6d-46e1-9cdf-3fafdd744e20 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:45.786579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa018582-3a6d-46e1-9cdf-3fafdd744e20 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:45.787025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa018582-3a6d-46e1-9cdf-3fafdd744e20 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:45.787771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa018582-3a6d-46e1-9cdf-3fafdd744e20 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:45.788224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa018582-3a6d-46e1-9cdf-3fafdd744e20 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:45.816312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa018582-3a6d-46e1-9cdf-3fafdd744e20 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Jul 19 12:37:45.816855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 298/602] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:46.047429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:46.048036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:46.054439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:46.054896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:46.055657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:46.056097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:46.118410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:46.126207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f436a743-3e64-4002-a577-2d682babfc32 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082816 Jul 19 12:37:46.126818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 305/603] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:46 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:46.827169 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0943c862-7e85-4399-b57b-d6739880ac27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:46.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0943c862-7e85-4399-b57b-d6739880ac27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:46.834533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0943c862-7e85-4399-b57b-d6739880ac27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:46.834981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0943c862-7e85-4399-b57b-d6739880ac27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:46.835745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0943c862-7e85-4399-b57b-d6739880ac27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:46.836198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0943c862-7e85-4399-b57b-d6739880ac27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:46.864494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0943c862-7e85-4399-b57b-d6739880ac27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Jul 19 12:37:46.864969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 299/604] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:47.143656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:47.144259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:47.150765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:47.151220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:47.152010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:47.152478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:47.211902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:47.219324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e6fce64f-5442-4024-94a1-148a72b85ce1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080419 Jul 19 12:37:47.220405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 306/605] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:47 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:47.876590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1e71878c-1ff5-456f-8af5-8fbede794931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:47.877454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1e71878c-1ff5-456f-8af5-8fbede794931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:47.883858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e71878c-1ff5-456f-8af5-8fbede794931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:47.884412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e71878c-1ff5-456f-8af5-8fbede794931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:47.885176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e71878c-1ff5-456f-8af5-8fbede794931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:47.885612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e71878c-1ff5-456f-8af5-8fbede794931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:47.909852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:47.914700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1e71878c-1ff5-456f-8af5-8fbede794931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Jul 19 12:37:47.915248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 300/606] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:48.236350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:48.236964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:48.243356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:48.243795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:48.244586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:48.245047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:48.304938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:48.312250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-59617360-e5ed-4cc6-ab8c-d1c39de59302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080235 Jul 19 12:37:48.312815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 307/607] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:48 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:48.926705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-860135f1-0d6c-4737-a70d-acf6533cb8d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:48.927558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-860135f1-0d6c-4737-a70d-acf6533cb8d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:48.934083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-860135f1-0d6c-4737-a70d-acf6533cb8d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:48.934537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-860135f1-0d6c-4737-a70d-acf6533cb8d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:48.935320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-860135f1-0d6c-4737-a70d-acf6533cb8d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:48.935764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-860135f1-0d6c-4737-a70d-acf6533cb8d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:48.964239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-860135f1-0d6c-4737-a70d-acf6533cb8d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041824 Jul 19 12:37:48.964787 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 301/608] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:49.329218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:49.329827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:49.337150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:49.337603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:49.338356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:49.338794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:49.398632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:49.405975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ea376245-2874-4085-aca6-9c57c39a9b30 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080680 Jul 19 12:37:49.406532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 308/609] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:49 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:49.975853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af812da5-b1b0-4e2b-a6a2-85b851485498 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:49.976825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af812da5-b1b0-4e2b-a6a2-85b851485498 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:49.983232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af812da5-b1b0-4e2b-a6a2-85b851485498 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:49.983689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af812da5-b1b0-4e2b-a6a2-85b851485498 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:49.984492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af812da5-b1b0-4e2b-a6a2-85b851485498 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:49.984937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af812da5-b1b0-4e2b-a6a2-85b851485498 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:50.013596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af812da5-b1b0-4e2b-a6a2-85b851485498 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Jul 19 12:37:50.014144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 302/610] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:50.429107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:50.429639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:50.436403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:50.436857 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:50.437638 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:50.438076 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:50.507205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:50.514652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fa100c21-8849-4a4c-a98e-faa983a1f130 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.089456 Jul 19 12:37:50.515217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 309/611] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:50 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:51.024430 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-71c34c19-7b83-4fd6-bd4e-c820d96c0b7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:51.025307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-71c34c19-7b83-4fd6-bd4e-c820d96c0b7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:51.031876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71c34c19-7b83-4fd6-bd4e-c820d96c0b7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:51.032381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71c34c19-7b83-4fd6-bd4e-c820d96c0b7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:51.033144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71c34c19-7b83-4fd6-bd4e-c820d96c0b7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:51.033580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71c34c19-7b83-4fd6-bd4e-c820d96c0b7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:51.061771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-71c34c19-7b83-4fd6-bd4e-c820d96c0b7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Jul 19 12:37:51.062313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 303/612] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:51.530742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:51.531349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:51.538223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:51.538671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:51.539424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:51.539859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:51.598817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:51.606143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fc0a8163-c3d9-4af2-ba65-ec17912ca310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079228 Jul 19 12:37:51.606714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 310/613] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:51 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:52.073227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-09b5c177-173d-4c24-967b-58609e071fdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:52.074149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-09b5c177-173d-4c24-967b-58609e071fdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:52.076487 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=56 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:52.081816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09b5c177-173d-4c24-967b-58609e071fdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:52.082264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09b5c177-173d-4c24-967b-58609e071fdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:52.083024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09b5c177-173d-4c24-967b-58609e071fdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:52.083457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09b5c177-173d-4c24-967b-58609e071fdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:52.112213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-09b5c177-173d-4c24-967b-58609e071fdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Jul 19 12:37:52.112770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 304/614] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:52.622900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:52.623543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:52.626198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=58 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:52.631396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:52.631850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:52.632647 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:52.633091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:52.694826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:52.702243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c12b1107-9f47-4cc1-aa67-0f48c7482198 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083209 Jul 19 12:37:52.702811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 311/615] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:52 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:53.123995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-59771ff0-e98d-4219-a5c1-2f3f6c0e1a8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:53.125218 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-59771ff0-e98d-4219-a5c1-2f3f6c0e1a8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:53.131740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59771ff0-e98d-4219-a5c1-2f3f6c0e1a8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:53.132201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59771ff0-e98d-4219-a5c1-2f3f6c0e1a8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:53.132981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59771ff0-e98d-4219-a5c1-2f3f6c0e1a8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:53.133414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59771ff0-e98d-4219-a5c1-2f3f6c0e1a8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:53.161403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-59771ff0-e98d-4219-a5c1-2f3f6c0e1a8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Jul 19 12:37:53.161979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 305/616] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:53.718874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:53.719494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:53.726055 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:53.726506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:53.727271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:53.727706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:53.787873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:53.795246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-717f4849-6f9e-4975-bfbe-07049591439c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080270 Jul 19 12:37:53.795801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 312/617] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:53 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:54.172052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bdcf4fca-b14a-4331-a41f-de1af8cb2e86 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:54.173501 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bdcf4fca-b14a-4331-a41f-de1af8cb2e86 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:54.179927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdcf4fca-b14a-4331-a41f-de1af8cb2e86 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:54.180413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdcf4fca-b14a-4331-a41f-de1af8cb2e86 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:54.181173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdcf4fca-b14a-4331-a41f-de1af8cb2e86 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:54.181604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdcf4fca-b14a-4331-a41f-de1af8cb2e86 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:54.203187 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:37:54.205754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments (ip 10.222.0.13) !!! Jul 19 12:37:54.212806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bdcf4fca-b14a-4331-a41f-de1af8cb2e86 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Jul 19 12:37:54.213785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 306/618] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:54.812119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:54.812751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:54.819160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:54.819609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:54.820398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:54.820829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:54.882934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:54.890248 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bb88eb30-8340-4c0d-93ca-ca9aa789fb28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081979 Jul 19 12:37:54.890802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 313/619] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:54 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:55.223702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5e444d3-e1ce-4c91-b5fa-39d7fea4f720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:55.224586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b5e444d3-e1ce-4c91-b5fa-39d7fea4f720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:55.230948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e444d3-e1ce-4c91-b5fa-39d7fea4f720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:55.231400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e444d3-e1ce-4c91-b5fa-39d7fea4f720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:55.232150 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e444d3-e1ce-4c91-b5fa-39d7fea4f720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:55.232603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e444d3-e1ce-4c91-b5fa-39d7fea4f720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:55.261576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5e444d3-e1ce-4c91-b5fa-39d7fea4f720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041927 Jul 19 12:37:55.262122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 307/620] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:55.907618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:55.908201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:55.914614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:55.915066 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:55.915829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:55.916296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:55.975543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:55.982863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-98185ed4-f413-453a-9fdd-635f97c4c25a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079782 Jul 19 12:37:55.983429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 314/621] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:55 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:56.273162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-723734d9-c53d-45ef-a810-cec3bd4c0620 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:56.274116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-723734d9-c53d-45ef-a810-cec3bd4c0620 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:56.280509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-723734d9-c53d-45ef-a810-cec3bd4c0620 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:56.280958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-723734d9-c53d-45ef-a810-cec3bd4c0620 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:56.281715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-723734d9-c53d-45ef-a810-cec3bd4c0620 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:56.283021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-723734d9-c53d-45ef-a810-cec3bd4c0620 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:56.297547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:37:56.297744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:37:56.313234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-723734d9-c53d-45ef-a810-cec3bd4c0620 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Jul 19 12:37:56.313779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 308/622] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:57.000105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:57.001288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:57.007674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:57.008131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:57.008928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:57.009367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:57.071637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:57.078997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5aba819c-9973-44d9-b524-fe6c4ad00489 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083033 Jul 19 12:37:57.079559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 315/623] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:56 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:57.324791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa8345be-764b-46e9-b9bf-1b795a025e45 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:57.326213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa8345be-764b-46e9-b9bf-1b795a025e45 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:57.332771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8345be-764b-46e9-b9bf-1b795a025e45 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:57.333216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8345be-764b-46e9-b9bf-1b795a025e45 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:57.333971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8345be-764b-46e9-b9bf-1b795a025e45 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:57.334401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8345be-764b-46e9-b9bf-1b795a025e45 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:57.362368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa8345be-764b-46e9-b9bf-1b795a025e45 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 Jul 19 12:37:57.362941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 309/624] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:58.094644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:58.095287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:58.102226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:58.102681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:58.103449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:58.103890 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:58.164155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:58.171529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3c7a3fb4-aae7-4478-85ea-e6103e7d8f5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080729 Jul 19 12:37:58.172087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 316/625] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:58 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:58.373098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-48447b64-0f3b-4441-96d0-eec8bae15d08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:58.373945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-48447b64-0f3b-4441-96d0-eec8bae15d08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:58.380674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48447b64-0f3b-4441-96d0-eec8bae15d08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:58.381152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48447b64-0f3b-4441-96d0-eec8bae15d08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:58.381918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48447b64-0f3b-4441-96d0-eec8bae15d08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:58.382355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48447b64-0f3b-4441-96d0-eec8bae15d08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:58.410442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-48447b64-0f3b-4441-96d0-eec8bae15d08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041333 Jul 19 12:37:58.410982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 310/626] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:37:59.188474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:59.189081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:59.195466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:59.195914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:59.196707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:59.197146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:59.259713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:37:59.267547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4606380d-a738-427a-ac55-29755ae83cb3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082886 Jul 19 12:37:59.268103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 317/627] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:37:59 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:37:59.421774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-415c7a87-a82a-46a6-8657-f23cbaba195e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:37:59.422727 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-415c7a87-a82a-46a6-8657-f23cbaba195e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:37:59.429308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415c7a87-a82a-46a6-8657-f23cbaba195e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:59.429761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415c7a87-a82a-46a6-8657-f23cbaba195e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:59.430528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415c7a87-a82a-46a6-8657-f23cbaba195e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:37:59.430967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415c7a87-a82a-46a6-8657-f23cbaba195e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:37:59.459869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-415c7a87-a82a-46a6-8657-f23cbaba195e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Jul 19 12:37:59.460372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 311/628] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:37:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:00.284098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:00.284766 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:00.291140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:00.291594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:00.292391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:00.292832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:00.352524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:00.360544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-de0c78a7-d715-431d-82a1-975a848afbec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079730 Jul 19 12:38:00.361091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 318/629] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:00 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:00.471640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3bc788d3-63fc-4805-b892-44afdc5d2908 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:00.472585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3bc788d3-63fc-4805-b892-44afdc5d2908 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:00.478950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc788d3-63fc-4805-b892-44afdc5d2908 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:00.479395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc788d3-63fc-4805-b892-44afdc5d2908 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:00.480149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc788d3-63fc-4805-b892-44afdc5d2908 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:00.480609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc788d3-63fc-4805-b892-44afdc5d2908 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:00.509213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3bc788d3-63fc-4805-b892-44afdc5d2908 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042009 Jul 19 12:38:00.509763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 312/630] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:01.377232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:01.377840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:01.384189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:01.384651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:01.385408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:01.385842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:01.445291 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:01.452644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e22a5db0-081d-4c87-8ecf-b62553e0fc6c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079567 Jul 19 12:38:01.453205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 319/631] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:01 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:01.521291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f0310d0-82f1-4b02-b27c-111718899803 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:01.522213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f0310d0-82f1-4b02-b27c-111718899803 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:01.528117 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0310d0-82f1-4b02-b27c-111718899803 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:01.528596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0310d0-82f1-4b02-b27c-111718899803 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:01.529354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0310d0-82f1-4b02-b27c-111718899803 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:01.529784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0310d0-82f1-4b02-b27c-111718899803 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:01.564516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f0310d0-82f1-4b02-b27c-111718899803 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047801 Jul 19 12:38:01.565069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 313/632] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:02.468501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:02.469116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:02.475263 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:02.475720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:02.476514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:02.476956 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:02.537518 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:02.545052 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-82eb5659-aaa5-4a43-9e3d-dd257c1b4d6a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080449 Jul 19 12:38:02.545622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 320/633] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:02 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:02.574971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c3fed40-db78-456e-b010-3ae56db86169 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:02.575962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c3fed40-db78-456e-b010-3ae56db86169 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:02.582932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3fed40-db78-456e-b010-3ae56db86169 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:02.583382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3fed40-db78-456e-b010-3ae56db86169 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:02.584147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3fed40-db78-456e-b010-3ae56db86169 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:02.584608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3fed40-db78-456e-b010-3ae56db86169 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:02.613237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c3fed40-db78-456e-b010-3ae56db86169 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 Jul 19 12:38:02.614125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 314/634] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:03.561932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:03.562543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:03.569496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:03.569950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:03.570754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:03.571189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:03.589494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:03.625304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-647c10fd-b4a7-45e3-ac16-4efcb9d92acb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:03.626738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-647c10fd-b4a7-45e3-ac16-4efcb9d92acb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:03.633694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-647c10fd-b4a7-45e3-ac16-4efcb9d92acb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:03.634153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-647c10fd-b4a7-45e3-ac16-4efcb9d92acb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:03.634932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-647c10fd-b4a7-45e3-ac16-4efcb9d92acb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:03.635382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-647c10fd-b4a7-45e3-ac16-4efcb9d92acb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:03.638110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:03.646153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8885bbaf-757f-4b2c-a7df-c118e5cd809a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088084 Jul 19 12:38:03.646722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 321/635] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:03.665364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-647c10fd-b4a7-45e3-ac16-4efcb9d92acb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Jul 19 12:38:03.665906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 315/636] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:04.663243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:04.663858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:04.670319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:04.670770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:04.671610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:04.672057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:04.676797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8643052a-d82b-424b-bb16-4855014d0df6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:04.677722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8643052a-d82b-424b-bb16-4855014d0df6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:04.684105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8643052a-d82b-424b-bb16-4855014d0df6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:04.684579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8643052a-d82b-424b-bb16-4855014d0df6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:04.685347 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8643052a-d82b-424b-bb16-4855014d0df6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:04.685777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8643052a-d82b-424b-bb16-4855014d0df6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:04.715503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8643052a-d82b-424b-bb16-4855014d0df6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Jul 19 12:38:04.716088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 316/637] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:04.734926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:04.742330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ac21ab6e-d558-4400-931f-3867d89eba02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082829 Jul 19 12:38:04.742888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 322/638] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:04 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:05.729433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-402d9b60-2633-4acf-9351-28be7cca666c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:05.730358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-402d9b60-2633-4acf-9351-28be7cca666c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:05.737449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-402d9b60-2633-4acf-9351-28be7cca666c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:05.737905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-402d9b60-2633-4acf-9351-28be7cca666c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:05.738680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-402d9b60-2633-4acf-9351-28be7cca666c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:05.739118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-402d9b60-2633-4acf-9351-28be7cca666c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:05.756189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:05.758840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:05.759451 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:05.765809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:05.766258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:05.767011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:05.767446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:05.770652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-402d9b60-2633-4acf-9351-28be7cca666c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Jul 19 12:38:05.771300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 317/639] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:05.828482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:05.836009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6734bd85-7bcd-43ed-a204-0591c821acb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081159 Jul 19 12:38:05.836616 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 323/640] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:05 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:38:06.781794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ff0fd02e-4932-400c-a9c0-cc18888fa624 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:06.782714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ff0fd02e-4932-400c-a9c0-cc18888fa624 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:06.789421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff0fd02e-4932-400c-a9c0-cc18888fa624 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:06.789873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff0fd02e-4932-400c-a9c0-cc18888fa624 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:06.790629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff0fd02e-4932-400c-a9c0-cc18888fa624 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:06.791062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff0fd02e-4932-400c-a9c0-cc18888fa624 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:06.821044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ff0fd02e-4932-400c-a9c0-cc18888fa624 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Jul 19 12:38:06.821598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 318/641] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:06.852966 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:06.853571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:06.860675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:06.861135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:06.861936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:06.862379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:06.921353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:06.929236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ac42e1c9-e253-41a1-bd82-cfb304572ec1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080005 Jul 19 12:38:06.929798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 324/642] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:07.833084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab8849d8-c9dd-4f75-aa9f-cc1922b2e4a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:07.834004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab8849d8-c9dd-4f75-aa9f-cc1922b2e4a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:07.840437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8849d8-c9dd-4f75-aa9f-cc1922b2e4a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:07.840886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8849d8-c9dd-4f75-aa9f-cc1922b2e4a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:07.841648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8849d8-c9dd-4f75-aa9f-cc1922b2e4a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:07.842083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8849d8-c9dd-4f75-aa9f-cc1922b2e4a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:07.870319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab8849d8-c9dd-4f75-aa9f-cc1922b2e4a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041729 Jul 19 12:38:07.870797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 319/643] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:07.946138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:07.946735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:07.953546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:07.954552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:07.955307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:07.955742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:08.017643 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:08.025007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dac02fde-4771-4f4d-9b04-f133e96a2be4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082574 Jul 19 12:38:08.025630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 325/644] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:08.882304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-737d158e-658a-41c8-8aea-ddec25f065f4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:08.883162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-737d158e-658a-41c8-8aea-ddec25f065f4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:08.889574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-737d158e-658a-41c8-8aea-ddec25f065f4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:08.890023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-737d158e-658a-41c8-8aea-ddec25f065f4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:08.890774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-737d158e-658a-41c8-8aea-ddec25f065f4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:08.891245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-737d158e-658a-41c8-8aea-ddec25f065f4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:08.919011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-737d158e-658a-41c8-8aea-ddec25f065f4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040770 Jul 19 12:38:08.919551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 320/645] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:09.041563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:09.042176 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:09.049223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:09.049679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:09.050440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:09.050882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:09.112152 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:09.119923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7d636783-cd3a-48de-a387-bcd945c99033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082153 Jul 19 12:38:09.120519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 326/646] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:09 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:09.930675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ae71be0-4cdc-40e3-8fa9-4063ec7dfdae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:09.931529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ae71be0-4cdc-40e3-8fa9-4063ec7dfdae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:09.938092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ae71be0-4cdc-40e3-8fa9-4063ec7dfdae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:09.938547 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ae71be0-4cdc-40e3-8fa9-4063ec7dfdae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:09.939342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ae71be0-4cdc-40e3-8fa9-4063ec7dfdae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:09.939801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ae71be0-4cdc-40e3-8fa9-4063ec7dfdae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:09.970095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ae71be0-4cdc-40e3-8fa9-4063ec7dfdae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Jul 19 12:38:09.970653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 321/647] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:10.137285 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:10.137904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:10.144858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:10.145315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:10.146089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:10.146530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:10.207993 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:10.215515 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-850bea92-c018-48c7-95cf-99c05a1daa17 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082110 Jul 19 12:38:10.216082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 327/648] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:10 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:10.981641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-91473072-13c5-4e47-84d1-e47f6e031092 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:10.982568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-91473072-13c5-4e47-84d1-e47f6e031092 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:10.989646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91473072-13c5-4e47-84d1-e47f6e031092 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:10.990096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91473072-13c5-4e47-84d1-e47f6e031092 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:10.990871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91473072-13c5-4e47-84d1-e47f6e031092 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:10.991311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91473072-13c5-4e47-84d1-e47f6e031092 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:11.019462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-91473072-13c5-4e47-84d1-e47f6e031092 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041733 Jul 19 12:38:11.020023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 322/649] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:11.231286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:11.231998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:11.238997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:11.239448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:11.240240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:11.240704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:11.301738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:11.309095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-39526f1f-55ce-428d-9434-4dc7cbd79fbe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081624 Jul 19 12:38:11.309660 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 328/650] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:11 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:12.030776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba2afcc7-88af-4caa-a044-b034bf69531f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:12.031762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba2afcc7-88af-4caa-a044-b034bf69531f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:12.038411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba2afcc7-88af-4caa-a044-b034bf69531f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:12.038858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba2afcc7-88af-4caa-a044-b034bf69531f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:12.039610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba2afcc7-88af-4caa-a044-b034bf69531f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:12.040042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba2afcc7-88af-4caa-a044-b034bf69531f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:12.068945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba2afcc7-88af-4caa-a044-b034bf69531f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Jul 19 12:38:12.069483 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 323/651] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:12.425159 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:12.425769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:12.431635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:12.432098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:12.432934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:12.433367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:12.495767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:12.503433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-33e457d6-31aa-4d7b-8e50-0e377ccd32cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.181746 Jul 19 12:38:12.503986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 329/652] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:12 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:13.080822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f6f93438-d467-4066-9b97-0a65d3491fac tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:13.081731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f6f93438-d467-4066-9b97-0a65d3491fac tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:13.088099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6f93438-d467-4066-9b97-0a65d3491fac tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:13.088569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6f93438-d467-4066-9b97-0a65d3491fac tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:13.089322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6f93438-d467-4066-9b97-0a65d3491fac tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:13.089751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6f93438-d467-4066-9b97-0a65d3491fac tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:13.117933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f6f93438-d467-4066-9b97-0a65d3491fac tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041541 Jul 19 12:38:13.118506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 324/653] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:13.520844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:13.521496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:13.527874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:13.528363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:13.529131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:13.529571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:13.589170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:13.596477 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0098ab17-969a-499b-86dc-254a4567ece6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079461 Jul 19 12:38:13.597063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 330/654] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:14.129802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a3ede29a-32d7-43a8-819a-d3ab8703c4b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:14.130730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a3ede29a-32d7-43a8-819a-d3ab8703c4b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:14.137259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ede29a-32d7-43a8-819a-d3ab8703c4b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:14.137700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ede29a-32d7-43a8-819a-d3ab8703c4b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:14.138474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ede29a-32d7-43a8-819a-d3ab8703c4b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:14.138976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ede29a-32d7-43a8-819a-d3ab8703c4b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:14.168330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a3ede29a-32d7-43a8-819a-d3ab8703c4b0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 Jul 19 12:38:14.168931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 325/655] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:14.613742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:14.614433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:14.621098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:14.621677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:14.622449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:14.623015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:14.683317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:14.691164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-75e0d162-453d-4c7d-a41b-44661dacee4c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081987 Jul 19 12:38:14.691725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 331/656] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:15.178995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-212cd716-4052-4fc5-bf45-87ad47a27696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:15.179899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-212cd716-4052-4fc5-bf45-87ad47a27696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:15.186279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-212cd716-4052-4fc5-bf45-87ad47a27696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:15.186721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-212cd716-4052-4fc5-bf45-87ad47a27696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:15.187471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-212cd716-4052-4fc5-bf45-87ad47a27696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:15.187904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-212cd716-4052-4fc5-bf45-87ad47a27696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:15.215736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-212cd716-4052-4fc5-bf45-87ad47a27696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040685 Jul 19 12:38:15.216305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 326/657] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:15.707402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:15.708044 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:15.714494 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:15.714944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:15.715707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:15.716148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:15.779203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:15.787037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-63ee67cb-bb05-46df-9a01-e55076982ce7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084109 Jul 19 12:38:15.787608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 332/658] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:15 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:16.228074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-be3fe8d1-0e6f-4a4c-aea0-dee0bc6d6d54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:16.229132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-be3fe8d1-0e6f-4a4c-aea0-dee0bc6d6d54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:16.236076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3fe8d1-0e6f-4a4c-aea0-dee0bc6d6d54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:16.236556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3fe8d1-0e6f-4a4c-aea0-dee0bc6d6d54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:16.237308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3fe8d1-0e6f-4a4c-aea0-dee0bc6d6d54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:16.237737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3fe8d1-0e6f-4a4c-aea0-dee0bc6d6d54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:16.265406 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-be3fe8d1-0e6f-4a4c-aea0-dee0bc6d6d54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041310 Jul 19 12:38:16.265940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 327/659] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:16.805534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:16.806627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:16.814026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:16.814488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:16.815262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:16.815704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:16.876456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:16.884074 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-651aa4f4-707b-4b23-a364-28a3a98b8866 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084168 Jul 19 12:38:16.884661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 333/660] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:16 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:17.277032 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8652881f-ea08-4f04-a8a4-72123280580e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:17.277990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8652881f-ea08-4f04-a8a4-72123280580e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:17.285083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8652881f-ea08-4f04-a8a4-72123280580e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:17.285536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8652881f-ea08-4f04-a8a4-72123280580e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:17.286297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8652881f-ea08-4f04-a8a4-72123280580e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:17.286731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8652881f-ea08-4f04-a8a4-72123280580e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:17.314168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8652881f-ea08-4f04-a8a4-72123280580e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041107 Jul 19 12:38:17.314709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 328/661] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:17.899940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:17.900508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:17.906928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:17.907389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:17.908155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:17.908620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:17.970241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:17.977641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bf5b0e1c-77ee-492d-a503-4794aeac5641 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081681 Jul 19 12:38:17.978203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 334/662] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:18.325928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e75c538a-c6a1-4aac-925c-dc19b599f4fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:18.326939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e75c538a-c6a1-4aac-925c-dc19b599f4fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:18.333235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e75c538a-c6a1-4aac-925c-dc19b599f4fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:18.333680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e75c538a-c6a1-4aac-925c-dc19b599f4fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:18.334447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e75c538a-c6a1-4aac-925c-dc19b599f4fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:18.334876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e75c538a-c6a1-4aac-925c-dc19b599f4fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:18.363720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e75c538a-c6a1-4aac-925c-dc19b599f4fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041713 Jul 19 12:38:18.364289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 329/663] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:18.993991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:18.994603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:19.002058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:19.002510 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:19.003271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:19.003718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:19.061424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:19.069357 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-648faf74-4ddb-4206-9b80-14757a2edd7c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079212 Jul 19 12:38:19.069924 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 335/664] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:19.375439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da891778-4ec3-43f4-9a24-33bfa93ecb92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:19.376314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da891778-4ec3-43f4-9a24-33bfa93ecb92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:19.382714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da891778-4ec3-43f4-9a24-33bfa93ecb92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:19.383166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da891778-4ec3-43f4-9a24-33bfa93ecb92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:19.383921 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da891778-4ec3-43f4-9a24-33bfa93ecb92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:19.384411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da891778-4ec3-43f4-9a24-33bfa93ecb92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:19.413247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da891778-4ec3-43f4-9a24-33bfa93ecb92 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Jul 19 12:38:19.413812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 330/665] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:20.085960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:20.086574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:20.093065 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:20.093516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:20.094769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:20.095215 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:20.157499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:20.165061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3cfc890e-8ac5-44c4-946b-04037889abee tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082930 Jul 19 12:38:20.165637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 336/666] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:20.425553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52889ec2-4da1-43bb-87df-70e746806849 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:20.426397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52889ec2-4da1-43bb-87df-70e746806849 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:20.432931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52889ec2-4da1-43bb-87df-70e746806849 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:20.433384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52889ec2-4da1-43bb-87df-70e746806849 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:20.434146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52889ec2-4da1-43bb-87df-70e746806849 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:20.434581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52889ec2-4da1-43bb-87df-70e746806849 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:20.465600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52889ec2-4da1-43bb-87df-70e746806849 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Jul 19 12:38:20.466162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 331/667] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:21.182625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:21.183179 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:21.190812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:21.191274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:21.192069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:21.192540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:21.258855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:21.266263 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5b33c4d9-8ed9-4488-a5cd-c5c0be5db3d7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.087636 Jul 19 12:38:21.266830 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 337/668] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:21.477748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b55e137d-c32e-45d4-b634-e2e2c83306ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:21.478663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b55e137d-c32e-45d4-b634-e2e2c83306ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:21.485769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55e137d-c32e-45d4-b634-e2e2c83306ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:21.486208 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55e137d-c32e-45d4-b634-e2e2c83306ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:21.486960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55e137d-c32e-45d4-b634-e2e2c83306ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:21.487392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55e137d-c32e-45d4-b634-e2e2c83306ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:21.520086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b55e137d-c32e-45d4-b634-e2e2c83306ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Jul 19 12:38:21.520819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 332/669] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:22.282837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:22.284126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:22.290527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:22.290985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:22.291814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:22.292218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:22.296351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:22.354158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:22.361541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0ee34e7d-3851-4682-8824-d71bfb9b983f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082727 Jul 19 12:38:22.362113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 338/670] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:22 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:22.532672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-210797de-caee-4477-b5a6-a4979b5683fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:22.533591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-210797de-caee-4477-b5a6-a4979b5683fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:22.535847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=58 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:22.541312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-210797de-caee-4477-b5a6-a4979b5683fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:22.541764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-210797de-caee-4477-b5a6-a4979b5683fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:22.542569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-210797de-caee-4477-b5a6-a4979b5683fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:22.542963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-210797de-caee-4477-b5a6-a4979b5683fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:22.571848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-210797de-caee-4477-b5a6-a4979b5683fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Jul 19 12:38:22.572497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 333/671] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:23.378084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:23.378695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:23.380994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:23.386607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:23.387062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:23.387829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:23.388300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:23.450453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:23.458737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-85db0415-de64-4271-a182-5077dcb9300c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084745 Jul 19 12:38:23.459305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 339/672] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:23 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:23.583958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7fa12aac-891b-410a-a095-c66771747011 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:23.584954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7fa12aac-891b-410a-a095-c66771747011 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:23.591314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fa12aac-891b-410a-a095-c66771747011 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:23.591767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fa12aac-891b-410a-a095-c66771747011 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:23.592558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fa12aac-891b-410a-a095-c66771747011 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:23.592997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fa12aac-891b-410a-a095-c66771747011 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:23.597245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:23.622495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7fa12aac-891b-410a-a095-c66771747011 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042514 Jul 19 12:38:23.623054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 334/673] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:24.475374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:24.475983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:24.483612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:24.484068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:24.485159 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:24.485604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:24.549242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:24.556516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-891e0c27-1572-43e3-af3e-4083638b4f56 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085168 Jul 19 12:38:24.557078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 340/674] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:24 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:24.634671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c41b5bea-fe0e-454c-92bf-50adde0f0af3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:24.635595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c41b5bea-fe0e-454c-92bf-50adde0f0af3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:24.642971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41b5bea-fe0e-454c-92bf-50adde0f0af3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:24.643424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41b5bea-fe0e-454c-92bf-50adde0f0af3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:24.644202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41b5bea-fe0e-454c-92bf-50adde0f0af3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:24.644662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41b5bea-fe0e-454c-92bf-50adde0f0af3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:24.673353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c41b5bea-fe0e-454c-92bf-50adde0f0af3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042609 Jul 19 12:38:24.673907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 335/675] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:25.573086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:25.573757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:25.580158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:25.580705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:25.581470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:25.581914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:25.643317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:25.650723 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7930a0c0-e0a8-4487-a7bc-d59c1b0bc986 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081532 Jul 19 12:38:25.651283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 341/676] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:25 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:25.684755 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-306a3a38-face-46cb-bf42-bb3c41432db9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:25.685700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-306a3a38-face-46cb-bf42-bb3c41432db9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:25.692750 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306a3a38-face-46cb-bf42-bb3c41432db9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:25.693195 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306a3a38-face-46cb-bf42-bb3c41432db9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:25.693948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306a3a38-face-46cb-bf42-bb3c41432db9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:25.694384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-306a3a38-face-46cb-bf42-bb3c41432db9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:25.721885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-306a3a38-face-46cb-bf42-bb3c41432db9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041057 Jul 19 12:38:25.722414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 336/677] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:26.666825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:26.667433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:26.674655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:26.675104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:26.675866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:26.676350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:26.733466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-071216a7-3f14-4a85-a48e-322465e3c689 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:26.734355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-071216a7-3f14-4a85-a48e-322465e3c689 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:26.735779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:26.741519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-071216a7-3f14-4a85-a48e-322465e3c689 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:26.741988 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-071216a7-3f14-4a85-a48e-322465e3c689 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:26.742747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-071216a7-3f14-4a85-a48e-322465e3c689 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:26.743133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5550c794-bbf4-44e3-a78b-8aaa53abc861 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080208 Jul 19 12:38:26.743248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-071216a7-3f14-4a85-a48e-322465e3c689 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:26.743707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 342/678] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:26 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:26.773574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-071216a7-3f14-4a85-a48e-322465e3c689 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Jul 19 12:38:26.774117 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 337/679] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:27.758891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:27.759499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:27.766483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:27.766972 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:27.767733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:27.768168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:27.784925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f22d1799-ffdd-472f-87a2-1696a62890a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:27.785853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f22d1799-ffdd-472f-87a2-1696a62890a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:27.792334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22d1799-ffdd-472f-87a2-1696a62890a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:27.792903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22d1799-ffdd-472f-87a2-1696a62890a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:27.793688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22d1799-ffdd-472f-87a2-1696a62890a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:27.794133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22d1799-ffdd-472f-87a2-1696a62890a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:27.824050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f22d1799-ffdd-472f-87a2-1696a62890a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042960 Jul 19 12:38:27.824645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 338/680] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:27.828526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:27.836021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-83601e8c-9b96-4c73-9611-3f57b7ee74b0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080937 Jul 19 12:38:27.836628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 343/681] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:27 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:28.835647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af18dce5-afd5-4064-9fb7-b628343bbd74 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:28.836604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af18dce5-afd5-4064-9fb7-b628343bbd74 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:28.842999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af18dce5-afd5-4064-9fb7-b628343bbd74 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:28.843451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af18dce5-afd5-4064-9fb7-b628343bbd74 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:28.844957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af18dce5-afd5-4064-9fb7-b628343bbd74 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:28.845396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af18dce5-afd5-4064-9fb7-b628343bbd74 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:28.851990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:28.852639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:28.859052 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:28.859510 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:28.860314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:28.860757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:28.873753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af18dce5-afd5-4064-9fb7-b628343bbd74 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041964 Jul 19 12:38:28.874505 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 339/682] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:28.926103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:28.933558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-43fdaa39-d455-4c73-a76d-e2688a2a31af tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085355 Jul 19 12:38:28.934245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 344/683] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:28 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:38:29.886205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c16e00a-0e93-4506-ad2d-8212bebca840 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:29.887708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c16e00a-0e93-4506-ad2d-8212bebca840 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:29.894460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c16e00a-0e93-4506-ad2d-8212bebca840 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:29.894913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c16e00a-0e93-4506-ad2d-8212bebca840 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:29.895684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c16e00a-0e93-4506-ad2d-8212bebca840 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:29.896124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c16e00a-0e93-4506-ad2d-8212bebca840 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:29.926211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c16e00a-0e93-4506-ad2d-8212bebca840 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Jul 19 12:38:29.926793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 340/684] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:29.950077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:29.950685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:29.956968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:29.957419 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:29.958185 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:29.958622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:30.019706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:30.027125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4e821ff2-9857-4b1b-ae70-32df2db3906f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080830 Jul 19 12:38:30.028000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 345/685] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:29 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:30.938640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-53ba8293-8871-41c7-a010-d4a6375709ef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:30.939567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-53ba8293-8871-41c7-a010-d4a6375709ef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:30.948259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ba8293-8871-41c7-a010-d4a6375709ef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:30.948714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ba8293-8871-41c7-a010-d4a6375709ef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:30.949483 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ba8293-8871-41c7-a010-d4a6375709ef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:30.949922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ba8293-8871-41c7-a010-d4a6375709ef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:30.977810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-53ba8293-8871-41c7-a010-d4a6375709ef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Jul 19 12:38:30.978360 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 341/686] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:31.043915 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:31.044557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:31.051467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:31.051922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:31.052728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:31.053174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:31.112136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:31.119434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3ee041d6-456e-4ce2-83fc-c3079950cace tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079282 Jul 19 12:38:31.119997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 346/687] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:31 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:31.989810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bd1cd510-7146-4ee8-ac86-1f583ae68ce6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:31.990725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bd1cd510-7146-4ee8-ac86-1f583ae68ce6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:31.997160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1cd510-7146-4ee8-ac86-1f583ae68ce6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:31.997606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1cd510-7146-4ee8-ac86-1f583ae68ce6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:31.998358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1cd510-7146-4ee8-ac86-1f583ae68ce6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:31.998789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1cd510-7146-4ee8-ac86-1f583ae68ce6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:32.027052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bd1cd510-7146-4ee8-ac86-1f583ae68ce6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041189 Jul 19 12:38:32.027590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 342/688] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:32.136975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:32.137584 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:32.143664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:32.144121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:32.145960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:32.146339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:32.211104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:32.218525 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d8884bd0-9aa6-4384-8acb-037abe831d02 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085385 Jul 19 12:38:32.219573 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 347/689] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:32 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:33.038516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5f2b647-1a1e-4c58-8850-b65e3996f8a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:33.039429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b5f2b647-1a1e-4c58-8850-b65e3996f8a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:33.045756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5f2b647-1a1e-4c58-8850-b65e3996f8a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:33.046203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5f2b647-1a1e-4c58-8850-b65e3996f8a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:33.046956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5f2b647-1a1e-4c58-8850-b65e3996f8a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:33.047390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5f2b647-1a1e-4c58-8850-b65e3996f8a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:33.074886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5f2b647-1a1e-4c58-8850-b65e3996f8a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040312 Jul 19 12:38:33.075419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 343/690] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:33.235566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:33.236193 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:33.242568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:33.243020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:33.243776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:33.244266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:33.306969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:33.314354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-43ae6723-859b-4f32-a83e-f648e555924f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082630 Jul 19 12:38:33.314916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 348/691] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:33 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:34.086816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a4f352a-36bf-4523-b79a-2cb5a9de9609 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:34.087769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a4f352a-36bf-4523-b79a-2cb5a9de9609 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:34.094126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a4f352a-36bf-4523-b79a-2cb5a9de9609 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:34.094574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a4f352a-36bf-4523-b79a-2cb5a9de9609 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:34.095324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a4f352a-36bf-4523-b79a-2cb5a9de9609 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:34.095752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a4f352a-36bf-4523-b79a-2cb5a9de9609 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:34.123597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a4f352a-36bf-4523-b79a-2cb5a9de9609 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040728 Jul 19 12:38:34.124422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 344/692] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:34.330793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:34.331407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:34.337873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:34.338278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:34.339047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:34.339487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:34.399571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:34.407442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c4ddaf69-0dbd-4c23-bd19-e2436bc65472 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080641 Jul 19 12:38:34.408003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 349/693] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:34 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:35.136072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e410a1f1-59cb-47f1-a286-0f6dd442df42 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:35.137022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e410a1f1-59cb-47f1-a286-0f6dd442df42 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:35.143963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e410a1f1-59cb-47f1-a286-0f6dd442df42 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:35.144431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e410a1f1-59cb-47f1-a286-0f6dd442df42 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:35.145186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e410a1f1-59cb-47f1-a286-0f6dd442df42 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:35.145614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e410a1f1-59cb-47f1-a286-0f6dd442df42 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:35.173044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e410a1f1-59cb-47f1-a286-0f6dd442df42 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040919 Jul 19 12:38:35.173579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 345/694] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:35.424148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:35.424716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:35.431150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:35.431597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:35.432390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:35.432831 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:35.491913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:35.499407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-04e82ffb-1d8c-48f4-81db-4bcae3644c44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079400 Jul 19 12:38:35.499963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 350/695] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:35 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:36.184558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f93dc0c2-92e6-45b1-9f49-0fa25f5abe38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:36.185399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f93dc0c2-92e6-45b1-9f49-0fa25f5abe38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:36.191779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93dc0c2-92e6-45b1-9f49-0fa25f5abe38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:36.192238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93dc0c2-92e6-45b1-9f49-0fa25f5abe38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:36.192998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93dc0c2-92e6-45b1-9f49-0fa25f5abe38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:36.193429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93dc0c2-92e6-45b1-9f49-0fa25f5abe38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:36.222275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f93dc0c2-92e6-45b1-9f49-0fa25f5abe38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041729 Jul 19 12:38:36.222810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 346/696] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:36.516417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:36.517064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:36.524081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:36.524572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:36.525335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:36.525772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:36.584957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:36.592412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6a99dbe3-ec2e-4f37-85ee-9cebdec7d3fe tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079846 Jul 19 12:38:36.592985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 351/697] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:36 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:37.234358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da26ad5a-a3d7-448c-8bc4-74af04c7c747 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:37.236696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da26ad5a-a3d7-448c-8bc4-74af04c7c747 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:37.243092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da26ad5a-a3d7-448c-8bc4-74af04c7c747 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:37.243535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da26ad5a-a3d7-448c-8bc4-74af04c7c747 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:37.244315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da26ad5a-a3d7-448c-8bc4-74af04c7c747 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:37.244748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da26ad5a-a3d7-448c-8bc4-74af04c7c747 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:37.272126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da26ad5a-a3d7-448c-8bc4-74af04c7c747 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Jul 19 12:38:37.272688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 347/698] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:37.609087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:37.610265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:37.616820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:37.617278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:37.618050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:37.618493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:37.681053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:37.688442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-db58a8ed-76fa-48e7-a881-8268adb73302 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083251 Jul 19 12:38:37.689005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 352/699] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:37 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:38.283610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-48308d4d-e142-4c72-9e3a-245aab234ea4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:38.284607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-48308d4d-e142-4c72-9e3a-245aab234ea4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:38.290942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48308d4d-e142-4c72-9e3a-245aab234ea4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:38.291380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48308d4d-e142-4c72-9e3a-245aab234ea4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:38.292133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48308d4d-e142-4c72-9e3a-245aab234ea4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:38.292588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48308d4d-e142-4c72-9e3a-245aab234ea4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:38.321185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-48308d4d-e142-4c72-9e3a-245aab234ea4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041594 Jul 19 12:38:38.321727 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 348/700] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:38.704855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:38.705471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:38.711953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:38.712446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:38.713217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:38.713656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:38.773011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:38.780337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c76fa218-cba8-40c7-9010-1d134a04082c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079319 Jul 19 12:38:38.780901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 353/701] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:38 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:39.333329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04f1c9ac-7d1b-4101-a685-dd61c71c6347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:39.334248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04f1c9ac-7d1b-4101-a685-dd61c71c6347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:39.340614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f1c9ac-7d1b-4101-a685-dd61c71c6347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:39.341060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f1c9ac-7d1b-4101-a685-dd61c71c6347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:39.341812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f1c9ac-7d1b-4101-a685-dd61c71c6347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:39.342239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f1c9ac-7d1b-4101-a685-dd61c71c6347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:39.371126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04f1c9ac-7d1b-4101-a685-dd61c71c6347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Jul 19 12:38:39.371589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 349/702] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:39.797536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:39.798151 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:39.805092 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:39.805544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:39.806311 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:39.806752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:39.872105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:39.875751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:39.881679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-50e47dd6-1f90-48d6-a1dc-c70cccfdd61d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088063 Jul 19 12:38:39.882249 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 354/703] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:39 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:40.383154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-280e9b17-bf89-49ac-8e8b-37a604771a9e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:40.384077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-280e9b17-bf89-49ac-8e8b-37a604771a9e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:40.390463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-280e9b17-bf89-49ac-8e8b-37a604771a9e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:40.390906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-280e9b17-bf89-49ac-8e8b-37a604771a9e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:40.391664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-280e9b17-bf89-49ac-8e8b-37a604771a9e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:40.392096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-280e9b17-bf89-49ac-8e8b-37a604771a9e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:40.416549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:40.421533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-280e9b17-bf89-49ac-8e8b-37a604771a9e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jul 19 12:38:40.422273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 350/704] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:40.898722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:40.899326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:40.905733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:40.906180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:40.906937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:40.907372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:40.966570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:40.974164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-01005c68-7979-486b-8332-31b53e461858 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079493 Jul 19 12:38:40.974729 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 355/705] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:40 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:41.433318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c165da86-8572-4c64-b8c3-42e0bf5a676f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:41.434174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c165da86-8572-4c64-b8c3-42e0bf5a676f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:41.441420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c165da86-8572-4c64-b8c3-42e0bf5a676f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:41.441871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c165da86-8572-4c64-b8c3-42e0bf5a676f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:41.442636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c165da86-8572-4c64-b8c3-42e0bf5a676f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:41.443073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c165da86-8572-4c64-b8c3-42e0bf5a676f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:41.471089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c165da86-8572-4c64-b8c3-42e0bf5a676f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041741 Jul 19 12:38:41.471652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 351/706] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:41.991483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:41.992130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:41.998655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:41.999371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:42.000141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:42.000620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:42.062446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:42.069896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-46d6b087-7ba2-4d8e-b1f8-78a521eafcce tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082320 Jul 19 12:38:42.070465 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 356/707] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:41 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:42.482669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2aca35c5-371c-4428-b9e2-b316a1a7a04b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:42.483581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2aca35c5-371c-4428-b9e2-b316a1a7a04b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:42.490182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aca35c5-371c-4428-b9e2-b316a1a7a04b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:42.490633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aca35c5-371c-4428-b9e2-b316a1a7a04b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:42.491389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aca35c5-371c-4428-b9e2-b316a1a7a04b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:42.491818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aca35c5-371c-4428-b9e2-b316a1a7a04b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:42.520679 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2aca35c5-371c-4428-b9e2-b316a1a7a04b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042034 Jul 19 12:38:42.521222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 352/708] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:43.085914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:43.086524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:43.093138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:43.093590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:43.094345 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:43.094783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:43.153957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:43.161743 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-01a2fa77-ddf3-4dda-af16-22f1070a980e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079671 Jul 19 12:38:43.162294 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 357/709] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:43 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:43.532054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa25a0be-62c2-4197-bd65-6dc9ab8004da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:43.533666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa25a0be-62c2-4197-bd65-6dc9ab8004da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:43.540314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa25a0be-62c2-4197-bd65-6dc9ab8004da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:43.540772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa25a0be-62c2-4197-bd65-6dc9ab8004da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:43.541566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa25a0be-62c2-4197-bd65-6dc9ab8004da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:43.542005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa25a0be-62c2-4197-bd65-6dc9ab8004da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:43.569729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa25a0be-62c2-4197-bd65-6dc9ab8004da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Jul 19 12:38:43.570275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 353/710] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:44.178330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:44.178866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:44.185319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:44.185773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:44.186540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:44.186983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:44.248756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:44.256810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-73f78616-1d2b-4bdf-8b6c-f74d9990955e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082434 Jul 19 12:38:44.257375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 358/711] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:44 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:44.581162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4273d99d-c660-4769-bd8e-9fe253bf0943 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:44.582081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4273d99d-c660-4769-bd8e-9fe253bf0943 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:44.588559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4273d99d-c660-4769-bd8e-9fe253bf0943 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:44.589010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4273d99d-c660-4769-bd8e-9fe253bf0943 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:44.589760 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4273d99d-c660-4769-bd8e-9fe253bf0943 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:44.590191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4273d99d-c660-4769-bd8e-9fe253bf0943 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:44.619958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4273d99d-c660-4769-bd8e-9fe253bf0943 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Jul 19 12:38:44.620591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 354/712] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:45.273899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:45.274514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:45.281288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:45.281747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:45.282545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:45.282989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:45.344062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:45.351609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8705e710-1c3d-4575-a960-698cdb78ee77 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081581 Jul 19 12:38:45.352198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 359/713] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:45 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:45.631485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0df96e37-50ba-404b-9071-46cc9622a2ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:45.632450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0df96e37-50ba-404b-9071-46cc9622a2ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:45.638840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0df96e37-50ba-404b-9071-46cc9622a2ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:45.639284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0df96e37-50ba-404b-9071-46cc9622a2ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:45.640052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0df96e37-50ba-404b-9071-46cc9622a2ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:45.640523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0df96e37-50ba-404b-9071-46cc9622a2ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:45.668836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0df96e37-50ba-404b-9071-46cc9622a2ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Jul 19 12:38:45.669381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 355/714] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:46.367770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:46.368478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:46.375920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:46.376414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:46.377191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:46.377636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:46.440125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:46.447568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-09919b69-918a-472c-ae53-113443c72d79 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084276 Jul 19 12:38:46.448127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 360/715] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:46 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:46.680233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0c17326-6d62-44c3-80bb-629afd30a1fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:46.681161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0c17326-6d62-44c3-80bb-629afd30a1fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:46.687467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0c17326-6d62-44c3-80bb-629afd30a1fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:46.687914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0c17326-6d62-44c3-80bb-629afd30a1fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:46.688712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0c17326-6d62-44c3-80bb-629afd30a1fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:46.689147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0c17326-6d62-44c3-80bb-629afd30a1fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:46.717401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0c17326-6d62-44c3-80bb-629afd30a1fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041105 Jul 19 12:38:46.717942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 356/716] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:47.464557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:47.465171 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:47.471617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:47.472068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:47.472860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:47.473299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:47.534513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:47.541800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a0691425-4634-4cf1-8f97-49caf29cf778 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081083 Jul 19 12:38:47.542360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 361/717] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:47 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:47.729450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00a595c9-fd5e-4edf-a678-0c6a1cfe91e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:47.730367 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-00a595c9-fd5e-4edf-a678-0c6a1cfe91e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:47.737358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00a595c9-fd5e-4edf-a678-0c6a1cfe91e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:47.737807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00a595c9-fd5e-4edf-a678-0c6a1cfe91e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:47.738569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00a595c9-fd5e-4edf-a678-0c6a1cfe91e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:47.739002 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00a595c9-fd5e-4edf-a678-0c6a1cfe91e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:47.767073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-00a595c9-fd5e-4edf-a678-0c6a1cfe91e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Jul 19 12:38:47.767619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 357/718] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:48.558824 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:48.559436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:48.566354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:48.566810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:48.567575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:48.568013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:48.630698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:48.638171 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cdc6cfb7-7319-407a-a34d-5002a43a06e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083185 Jul 19 12:38:48.638741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 362/719] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:48 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:48.778357 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7941a832-35df-4e16-b194-091ec0f797e0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:48.779272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7941a832-35df-4e16-b194-091ec0f797e0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:48.785606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7941a832-35df-4e16-b194-091ec0f797e0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:48.786043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7941a832-35df-4e16-b194-091ec0f797e0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:48.786806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7941a832-35df-4e16-b194-091ec0f797e0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:48.787235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7941a832-35df-4e16-b194-091ec0f797e0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:48.814869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7941a832-35df-4e16-b194-091ec0f797e0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040447 Jul 19 12:38:48.815402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 358/720] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:49.655089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:49.655841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:49.664741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:49.665190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:49.665961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:49.666396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:49.727116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:49.734612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-35cc6bcd-bf52-4d16-a701-2ec728e9f033 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083343 Jul 19 12:38:49.735176 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 363/721] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:49 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:49.826771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4cf0b8f1-613a-4e62-aeba-85b3da6adecd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:49.827708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4cf0b8f1-613a-4e62-aeba-85b3da6adecd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:49.834772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cf0b8f1-613a-4e62-aeba-85b3da6adecd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:49.835244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cf0b8f1-613a-4e62-aeba-85b3da6adecd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:49.836042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cf0b8f1-613a-4e62-aeba-85b3da6adecd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:49.836518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cf0b8f1-613a-4e62-aeba-85b3da6adecd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:49.864992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4cf0b8f1-613a-4e62-aeba-85b3da6adecd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Jul 19 12:38:49.865509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 359/722] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:50.751715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:50.752387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:50.759238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:50.759686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:50.760468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:50.760903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:50.824639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:50.832011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-24be519b-ad3c-4bd8-af4e-8e5c7d083dc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084449 Jul 19 12:38:50.832604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 364/723] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:50 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:50.877221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4d7cccf-49ab-4811-ac42-975d895d89a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:50.878070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4d7cccf-49ab-4811-ac42-975d895d89a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:50.885003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d7cccf-49ab-4811-ac42-975d895d89a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:50.885447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d7cccf-49ab-4811-ac42-975d895d89a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:50.886204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d7cccf-49ab-4811-ac42-975d895d89a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:50.886639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d7cccf-49ab-4811-ac42-975d895d89a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:50.918059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4d7cccf-49ab-4811-ac42-975d895d89a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Jul 19 12:38:50.918613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 360/724] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:51.848965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:51.849571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:51.856068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:51.856546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:51.857301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:51.857737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:51.919603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:51.930035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-76d220af-8222-4ce9-8e3b-51c90b7c2ef3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:51.930949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-76d220af-8222-4ce9-8e3b-51c90b7c2ef3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:51.933537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-abcfa900-2732-4f6d-baa4-e2cb29a40a74 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088335 Jul 19 12:38:51.934115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 365/725] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:51 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:51.938236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76d220af-8222-4ce9-8e3b-51c90b7c2ef3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:51.938760 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76d220af-8222-4ce9-8e3b-51c90b7c2ef3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:51.939735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76d220af-8222-4ce9-8e3b-51c90b7c2ef3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:51.940277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76d220af-8222-4ce9-8e3b-51c90b7c2ef3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:51.970967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-76d220af-8222-4ce9-8e3b-51c90b7c2ef3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Jul 19 12:38:51.971521 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 361/726] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:52.950372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:52.950913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:52.957319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:52.957776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:52.958544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:52.959004 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:52.982847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2b67de98-9340-48a5-8009-06371ceef19b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:52.983768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2b67de98-9340-48a5-8009-06371ceef19b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:52.986062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=58 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:52.991366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b67de98-9340-48a5-8009-06371ceef19b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:52.991812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b67de98-9340-48a5-8009-06371ceef19b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:52.992607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b67de98-9340-48a5-8009-06371ceef19b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:52.993043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b67de98-9340-48a5-8009-06371ceef19b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:53.019923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:53.023161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2b67de98-9340-48a5-8009-06371ceef19b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Jul 19 12:38:53.023720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 362/727] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:38:53.028420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f3c106b0-7002-4521-a51d-14141d2979ba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081936 Jul 19 12:38:53.028982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 366/728] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:52 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:54.033950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b6aef484-de9c-40b6-b413-3e52f06cc041 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:54.034896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b6aef484-de9c-40b6-b413-3e52f06cc041 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:54.041990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6aef484-de9c-40b6-b413-3e52f06cc041 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:54.042434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6aef484-de9c-40b6-b413-3e52f06cc041 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:54.043194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6aef484-de9c-40b6-b413-3e52f06cc041 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:54.043619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6aef484-de9c-40b6-b413-3e52f06cc041 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:54.044555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:54.045175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:54.047460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:54.052655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:54.053111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:54.053883 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:54.054327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:54.072463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b6aef484-de9c-40b6-b413-3e52f06cc041 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042453 Jul 19 12:38:54.073019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 363/729] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:54.117984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:54.125630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9912f8d4-86de-471b-b932-eaec909b2d48 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084838 Jul 19 12:38:54.126195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 367/730] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:54 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:38:55.083945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4be8ab8a-9443-4a56-8492-4501660d2ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:55.084909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4be8ab8a-9443-4a56-8492-4501660d2ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:55.091245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be8ab8a-9443-4a56-8492-4501660d2ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:55.091691 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be8ab8a-9443-4a56-8492-4501660d2ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:55.092474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be8ab8a-9443-4a56-8492-4501660d2ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:55.092906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be8ab8a-9443-4a56-8492-4501660d2ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:55.121965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4be8ab8a-9443-4a56-8492-4501660d2ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Jul 19 12:38:55.121965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 364/731] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:55.141855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:55.143012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:55.150551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:55.151012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:55.151776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:55.152240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:55.218306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:55.226235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-15199966-0b07-4292-9243-f8e8406515c0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088842 Jul 19 12:38:55.226800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 368/732] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:55 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:56.133629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02dcc902-68d6-4100-b71e-b1cecade53e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:56.134485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-02dcc902-68d6-4100-b71e-b1cecade53e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:56.140856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02dcc902-68d6-4100-b71e-b1cecade53e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:56.141303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02dcc902-68d6-4100-b71e-b1cecade53e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:56.142059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02dcc902-68d6-4100-b71e-b1cecade53e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:56.142491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02dcc902-68d6-4100-b71e-b1cecade53e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:56.169950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02dcc902-68d6-4100-b71e-b1cecade53e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040954 Jul 19 12:38:56.170485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 365/733] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:56.243123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:56.243736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:56.250459 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:56.250913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:56.251672 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:56.252112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:56.312325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:56.320246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6f1faaf3-c390-4db5-a4f9-3adc0acdc7e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081434 Jul 19 12:38:56.320809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 369/734] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:56 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:57.181570 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dba5e2cf-8cd6-4db7-b054-486ec4a03e4a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:57.182525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dba5e2cf-8cd6-4db7-b054-486ec4a03e4a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:57.188973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba5e2cf-8cd6-4db7-b054-486ec4a03e4a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:57.189423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba5e2cf-8cd6-4db7-b054-486ec4a03e4a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:57.190186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba5e2cf-8cd6-4db7-b054-486ec4a03e4a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:57.190625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba5e2cf-8cd6-4db7-b054-486ec4a03e4a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:57.219889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dba5e2cf-8cd6-4db7-b054-486ec4a03e4a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 Jul 19 12:38:57.220500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 366/735] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:57.337174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:57.337778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:57.344088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:57.344570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:57.345323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:57.345759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:57.404951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:57.412583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e723f29b-029d-4753-a640-dcd17b95153f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079749 Jul 19 12:38:57.413153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 370/736] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:57 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:58.231665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2055cbb7-e61b-47f2-adec-f80fd0270205 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:58.232602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2055cbb7-e61b-47f2-adec-f80fd0270205 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:58.238928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2055cbb7-e61b-47f2-adec-f80fd0270205 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:58.239375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2055cbb7-e61b-47f2-adec-f80fd0270205 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:58.240762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2055cbb7-e61b-47f2-adec-f80fd0270205 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:58.241202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2055cbb7-e61b-47f2-adec-f80fd0270205 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:58.257349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:58.270070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2055cbb7-e61b-47f2-adec-f80fd0270205 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jul 19 12:38:58.270619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 367/737] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:58.428942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:58.429556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:58.435897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:58.436391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:58.437148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:58.437583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:58.454496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:58.497444 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:58.505012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0b798413-b09e-4c0e-b2f3-2d6da00cb607 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079958 Jul 19 12:38:58.505587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 371/738] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:58 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:38:59.281272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-46626096-e377-48d5-a523-d10d3648fd50 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:59.282231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-46626096-e377-48d5-a523-d10d3648fd50 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:59.288711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46626096-e377-48d5-a523-d10d3648fd50 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:59.289173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46626096-e377-48d5-a523-d10d3648fd50 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:59.289933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46626096-e377-48d5-a523-d10d3648fd50 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:59.290371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46626096-e377-48d5-a523-d10d3648fd50 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:59.319332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-46626096-e377-48d5-a523-d10d3648fd50 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Jul 19 12:38:59.319871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 368/739] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:38:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:38:59.521308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:38:59.521918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:38:59.528336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:59.528787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:59.529550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:38:59.529989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:38:59.591303 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:38:59.598610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e7d3d290-a6f3-43cf-b119-50b1a90baa43 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081146 Jul 19 12:38:59.599186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 372/740] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:38:59 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:00.330852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8954708-2738-439d-ba8a-9302e365b828 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:00.331703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8954708-2738-439d-ba8a-9302e365b828 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:00.338761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8954708-2738-439d-ba8a-9302e365b828 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:00.339213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8954708-2738-439d-ba8a-9302e365b828 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:00.339996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8954708-2738-439d-ba8a-9302e365b828 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:00.340449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8954708-2738-439d-ba8a-9302e365b828 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:00.368215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8954708-2738-439d-ba8a-9302e365b828 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041377 Jul 19 12:39:00.368765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 369/741] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:00.614812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:00.615940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:00.622525 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:00.622975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:00.623741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:00.624481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:00.683763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:00.691116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2a208476-6490-4bc0-8209-308a2f49ab8e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080195 Jul 19 12:39:00.691669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 373/742] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:00 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:01.379272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb969e3f-03c1-476c-aa2c-20ac66954d57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:01.380213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb969e3f-03c1-476c-aa2c-20ac66954d57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:01.386381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb969e3f-03c1-476c-aa2c-20ac66954d57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:01.386832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb969e3f-03c1-476c-aa2c-20ac66954d57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:01.387594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb969e3f-03c1-476c-aa2c-20ac66954d57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:01.388030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb969e3f-03c1-476c-aa2c-20ac66954d57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:01.416455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb969e3f-03c1-476c-aa2c-20ac66954d57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 Jul 19 12:39:01.417003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 370/743] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:01.708558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:01.709660 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:01.716067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:01.716563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:01.717334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:01.717787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:01.779869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:01.787215 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2929e182-a419-405e-ba75-7b43ce548076 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082688 Jul 19 12:39:01.787788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 374/744] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:01 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:39:02.429120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f51560ff-6ec7-45a2-b257-ebd34ce9b4b1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:02.429976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f51560ff-6ec7-45a2-b257-ebd34ce9b4b1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:02.436490 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51560ff-6ec7-45a2-b257-ebd34ce9b4b1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:02.436942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51560ff-6ec7-45a2-b257-ebd34ce9b4b1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:02.437705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51560ff-6ec7-45a2-b257-ebd34ce9b4b1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:02.438147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51560ff-6ec7-45a2-b257-ebd34ce9b4b1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:02.466537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f51560ff-6ec7-45a2-b257-ebd34ce9b4b1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042111 Jul 19 12:39:02.467078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 371/745] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:02.804022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:02.804689 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:02.810851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:02.811308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:02.812087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:02.812556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:02.873042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:02.880806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d37cc16f-d527-4397-999d-0dc862926e69 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081147 Jul 19 12:39:02.881456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 375/746] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:02 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:03.478272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3fd1503b-2d5f-4d83-887d-917f8b87c102 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:03.479188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3fd1503b-2d5f-4d83-887d-917f8b87c102 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:03.485596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fd1503b-2d5f-4d83-887d-917f8b87c102 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:03.486037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fd1503b-2d5f-4d83-887d-917f8b87c102 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:03.486782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fd1503b-2d5f-4d83-887d-917f8b87c102 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:03.487213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fd1503b-2d5f-4d83-887d-917f8b87c102 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:03.515810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3fd1503b-2d5f-4d83-887d-917f8b87c102 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Jul 19 12:39:03.516372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 372/747] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:03.906283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:03.906913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:03.913828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:03.914298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:03.915093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:03.915550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:03.979812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:03.987225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d85c58cf-6d65-4342-9375-094f1e37e84a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084853 Jul 19 12:39:03.987794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 376/748] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:04.527616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8da8ed53-5a1f-4087-a327-fe4f4b68d2cd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:04.528556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8da8ed53-5a1f-4087-a327-fe4f4b68d2cd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:04.534945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8da8ed53-5a1f-4087-a327-fe4f4b68d2cd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:04.535388 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8da8ed53-5a1f-4087-a327-fe4f4b68d2cd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:04.536138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8da8ed53-5a1f-4087-a327-fe4f4b68d2cd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:04.536598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8da8ed53-5a1f-4087-a327-fe4f4b68d2cd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:04.564378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8da8ed53-5a1f-4087-a327-fe4f4b68d2cd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040688 Jul 19 12:39:04.564937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 373/749] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:05.004711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:05.005322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:05.014652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:05.015117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:05.015891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:05.016376 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:05.076097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:05.083508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-12d231da-5272-49cd-aa24-8dd242b6a870 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082698 Jul 19 12:39:05.084664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 377/750] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:04 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:05.575280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1a04c3dd-b577-4456-9278-b0ef54babd5a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:05.576215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1a04c3dd-b577-4456-9278-b0ef54babd5a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:05.582609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a04c3dd-b577-4456-9278-b0ef54babd5a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:05.583050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a04c3dd-b577-4456-9278-b0ef54babd5a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:05.583872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a04c3dd-b577-4456-9278-b0ef54babd5a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:05.584336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a04c3dd-b577-4456-9278-b0ef54babd5a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:05.612702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1a04c3dd-b577-4456-9278-b0ef54babd5a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Jul 19 12:39:05.613264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 374/751] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:06.101336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:06.101880 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:06.108300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:06.108759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:06.109519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:06.109959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:06.170586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:06.178004 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a235e0b2-e82f-4371-ab96-7a619747a120 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081161 Jul 19 12:39:06.178568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 378/752] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:06.625367 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-35fc0fc6-028e-4f11-b380-1ba408443816 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:06.626315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-35fc0fc6-028e-4f11-b380-1ba408443816 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:06.633340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35fc0fc6-028e-4f11-b380-1ba408443816 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:06.633788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35fc0fc6-028e-4f11-b380-1ba408443816 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:06.634533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35fc0fc6-028e-4f11-b380-1ba408443816 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:06.634965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35fc0fc6-028e-4f11-b380-1ba408443816 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:06.662466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-35fc0fc6-028e-4f11-b380-1ba408443816 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041301 Jul 19 12:39:06.663007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 375/753] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:07.194386 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:07.194996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:07.201447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:07.201909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:07.202677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:07.203119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:07.268160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:07.279368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3b086e55-ef8a-40b2-bad5-b4ddaa988cbd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088545 Jul 19 12:39:07.280138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 379/754] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:07.674059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a818c010-8228-47bd-9bea-1ca0beff938a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:07.674973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a818c010-8228-47bd-9bea-1ca0beff938a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:07.681430 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a818c010-8228-47bd-9bea-1ca0beff938a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:07.681875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a818c010-8228-47bd-9bea-1ca0beff938a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:07.682647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a818c010-8228-47bd-9bea-1ca0beff938a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:07.683061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a818c010-8228-47bd-9bea-1ca0beff938a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:07.711237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a818c010-8228-47bd-9bea-1ca0beff938a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041065 Jul 19 12:39:07.711773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 376/755] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:08.296509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:08.297122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:08.304112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:08.304596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:08.305357 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:08.305796 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:08.368144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:08.375780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d72de685-ebbe-4dc6-a3b0-e9bfb0c3cc19 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083118 Jul 19 12:39:08.377146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 380/756] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:08 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:08.722621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c2a52a8c-5ce7-4114-853a-a2e8368d0d76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:08.723538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c2a52a8c-5ce7-4114-853a-a2e8368d0d76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:08.730516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a52a8c-5ce7-4114-853a-a2e8368d0d76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:08.730968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a52a8c-5ce7-4114-853a-a2e8368d0d76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:08.731721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a52a8c-5ce7-4114-853a-a2e8368d0d76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:08.732153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a52a8c-5ce7-4114-853a-a2e8368d0d76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:08.761018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c2a52a8c-5ce7-4114-853a-a2e8368d0d76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Jul 19 12:39:08.761557 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 377/757] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:09.393463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:09.393995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:09.401180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:09.401632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:09.402401 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:09.402838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:09.464530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:09.471989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6bc059ae-f5cc-4579-aab4-50a2188f7989 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082483 Jul 19 12:39:09.472585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 381/758] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:09 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:09.771740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ff9df264-78d8-4912-b0d1-041f5af63a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:09.772696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ff9df264-78d8-4912-b0d1-041f5af63a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:09.779139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff9df264-78d8-4912-b0d1-041f5af63a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:09.779595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff9df264-78d8-4912-b0d1-041f5af63a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:09.780396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff9df264-78d8-4912-b0d1-041f5af63a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:09.780839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff9df264-78d8-4912-b0d1-041f5af63a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:09.810345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ff9df264-78d8-4912-b0d1-041f5af63a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042502 Jul 19 12:39:09.810912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 378/759] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:10.487674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:10.488305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:10.494765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:10.495218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:10.495988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:10.496464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:10.556846 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:10.564137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6d017dfa-1241-465a-a3a4-5a0b1f5ecc8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080335 Jul 19 12:39:10.564718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 382/760] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:10 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:10.830938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-364528c7-fd50-4f0a-a297-e647729de78d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:10.831876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-364528c7-fd50-4f0a-a297-e647729de78d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:10.838868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-364528c7-fd50-4f0a-a297-e647729de78d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:10.839321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-364528c7-fd50-4f0a-a297-e647729de78d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:10.840237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-364528c7-fd50-4f0a-a297-e647729de78d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:10.840699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-364528c7-fd50-4f0a-a297-e647729de78d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:10.869188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-364528c7-fd50-4f0a-a297-e647729de78d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050511 Jul 19 12:39:10.869750 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 379/761] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:39:11.580841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:11.581439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:11.588101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:11.588586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:11.589347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:11.589787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:11.652297 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:11.659833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6bd3d8b2-efd8-4654-b659-6d9bb0f87cba tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082782 Jul 19 12:39:11.660428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 383/762] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:11 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:11.880994 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4a6ddd5-a325-4e01-a22f-008dd1be230f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:11.881844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f4a6ddd5-a325-4e01-a22f-008dd1be230f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:11.888209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4a6ddd5-a325-4e01-a22f-008dd1be230f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:11.888661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4a6ddd5-a325-4e01-a22f-008dd1be230f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:11.889419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4a6ddd5-a325-4e01-a22f-008dd1be230f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:11.889850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4a6ddd5-a325-4e01-a22f-008dd1be230f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:11.918895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f4a6ddd5-a325-4e01-a22f-008dd1be230f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041913 Jul 19 12:39:11.919439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 380/763] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:12.676747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:12.677864 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:12.684388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:12.684846 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:12.685611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:12.686054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:12.748379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:12.756836 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4b21cccc-6ae0-43bd-b541-b7ceb8e0237a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083939 Jul 19 12:39:12.757403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 384/764] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:12 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:12.930529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-54dfa8e3-fd96-4f86-baa7-a6113201c9f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:12.931453 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-54dfa8e3-fd96-4f86-baa7-a6113201c9f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:12.938030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54dfa8e3-fd96-4f86-baa7-a6113201c9f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:12.938482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54dfa8e3-fd96-4f86-baa7-a6113201c9f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:12.939247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54dfa8e3-fd96-4f86-baa7-a6113201c9f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:12.939686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54dfa8e3-fd96-4f86-baa7-a6113201c9f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:12.967828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-54dfa8e3-fd96-4f86-baa7-a6113201c9f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042002 Jul 19 12:39:12.968408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 381/765] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:13.773233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:13.773845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:13.780398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:13.780851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:13.781615 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:13.782054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:13.841184 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:13.848505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d391a910-29af-48e6-af35-1b0f1feeee75 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079235 Jul 19 12:39:13.849563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 385/766] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:13.979640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00f7603c-7cca-4e8f-a9f0-7b4ecc3cc4dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:13.980586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-00f7603c-7cca-4e8f-a9f0-7b4ecc3cc4dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:13.986893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00f7603c-7cca-4e8f-a9f0-7b4ecc3cc4dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:13.987336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00f7603c-7cca-4e8f-a9f0-7b4ecc3cc4dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:13.988107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00f7603c-7cca-4e8f-a9f0-7b4ecc3cc4dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:13.988549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00f7603c-7cca-4e8f-a9f0-7b4ecc3cc4dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:14.016991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-00f7603c-7cca-4e8f-a9f0-7b4ecc3cc4dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041271 Jul 19 12:39:14.017522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 382/767] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:14.865488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:14.866136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:14.872576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:14.873128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:14.874169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:14.874615 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:15.028693 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5a66cc7-a681-4a7d-81cd-3f13302dc2e8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:15.029663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5a66cc7-a681-4a7d-81cd-3f13302dc2e8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:15.036508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5a66cc7-a681-4a7d-81cd-3f13302dc2e8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:15.036963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5a66cc7-a681-4a7d-81cd-3f13302dc2e8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:15.037745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5a66cc7-a681-4a7d-81cd-3f13302dc2e8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:15.038181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5a66cc7-a681-4a7d-81cd-3f13302dc2e8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:15.072523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5a66cc7-a681-4a7d-81cd-3f13302dc2e8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047785 Jul 19 12:39:15.073131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 383/768] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:39:15.194375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:15.201817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-53cc799c-5b88-49a1-af50-7e462e6a4114 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.341071 Jul 19 12:39:15.202385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 386/769] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:16.084247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-818b5275-bf72-4d22-ab72-106be2a3cfe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:16.085161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-818b5275-bf72-4d22-ab72-106be2a3cfe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:16.091624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-818b5275-bf72-4d22-ab72-106be2a3cfe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:16.092096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-818b5275-bf72-4d22-ab72-106be2a3cfe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:16.092893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-818b5275-bf72-4d22-ab72-106be2a3cfe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:16.093334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-818b5275-bf72-4d22-ab72-106be2a3cfe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:16.096946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:16.122354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-818b5275-bf72-4d22-ab72-106be2a3cfe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Jul 19 12:39:16.122903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 384/770] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:16.218284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:16.218855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:16.225710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:16.226161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:16.226916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:16.227347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:16.289613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:16.296899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b78aca2d-5f17-453a-aaf0-68f1be39d63a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082533 Jul 19 12:39:16.297438 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 387/771] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:16 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:17.134873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40206db2-49af-4230-ad1a-23a419cc44a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:17.135821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40206db2-49af-4230-ad1a-23a419cc44a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:17.142226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40206db2-49af-4230-ad1a-23a419cc44a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:17.142676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40206db2-49af-4230-ad1a-23a419cc44a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:17.143436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40206db2-49af-4230-ad1a-23a419cc44a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:17.143873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40206db2-49af-4230-ad1a-23a419cc44a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:17.171346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40206db2-49af-4230-ad1a-23a419cc44a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Jul 19 12:39:17.171821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 385/772] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:17.313178 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:17.313782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:17.320783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:17.321229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:17.322001 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:17.322435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:17.326328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:17.384947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:17.392711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-aed91ac3-e4c6-4bb2-9863-217870b29938 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083397 Jul 19 12:39:17.393276 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 388/773] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:18.182612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d48da471-a050-45ff-ab17-f5cfec3d9cf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:18.183538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d48da471-a050-45ff-ab17-f5cfec3d9cf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:18.189986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d48da471-a050-45ff-ab17-f5cfec3d9cf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:18.190437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d48da471-a050-45ff-ab17-f5cfec3d9cf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:18.191196 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d48da471-a050-45ff-ab17-f5cfec3d9cf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:18.191636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d48da471-a050-45ff-ab17-f5cfec3d9cf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:18.219858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d48da471-a050-45ff-ab17-f5cfec3d9cf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Jul 19 12:39:18.220435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 386/774] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:18.409189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:18.409909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:18.416308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:18.416766 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:18.417529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:18.417968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:18.477529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:18.484813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7d3cc20f-bbce-49e1-9aab-3a522e93a842 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079438 Jul 19 12:39:18.485371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 389/775] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:19.231075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0ec3da6f-6f63-4737-a288-aefd3a211446 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:19.231987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0ec3da6f-6f63-4737-a288-aefd3a211446 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:19.238352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec3da6f-6f63-4737-a288-aefd3a211446 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:19.238802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec3da6f-6f63-4737-a288-aefd3a211446 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:19.240246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec3da6f-6f63-4737-a288-aefd3a211446 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:19.240680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec3da6f-6f63-4737-a288-aefd3a211446 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:19.269062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0ec3da6f-6f63-4737-a288-aefd3a211446 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Jul 19 12:39:19.269626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 387/776] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:19.501584 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:19.502100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:19.508621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:19.509072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:19.509832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:19.510273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:19.569681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:19.577040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2288788b-f0c5-4f57-9abc-d69b60d42bb9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079669 Jul 19 12:39:19.577604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 390/777] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:20.280676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18757d41-3a37-477e-a130-967848983a1a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:20.281594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18757d41-3a37-477e-a130-967848983a1a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:20.287902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18757d41-3a37-477e-a130-967848983a1a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:20.288427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18757d41-3a37-477e-a130-967848983a1a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:20.289189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18757d41-3a37-477e-a130-967848983a1a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:20.289623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18757d41-3a37-477e-a130-967848983a1a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:20.317917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18757d41-3a37-477e-a130-967848983a1a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 Jul 19 12:39:20.319386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 388/778] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:20.593909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:20.594442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:20.601564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:20.602018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:20.602787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:20.603218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:20.663894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:20.671236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cbf12aa7-42ce-473a-86b2-d3ad55595f1a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081207 Jul 19 12:39:20.671799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 391/779] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:21.330931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0a2b7c31-73b6-48ed-add5-ce6bcf3d1ae8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:21.332278 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0a2b7c31-73b6-48ed-add5-ce6bcf3d1ae8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:21.340759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c31-73b6-48ed-add5-ce6bcf3d1ae8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:21.341206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c31-73b6-48ed-add5-ce6bcf3d1ae8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:21.341963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c31-73b6-48ed-add5-ce6bcf3d1ae8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:21.342396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c31-73b6-48ed-add5-ce6bcf3d1ae8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:21.370076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0a2b7c31-73b6-48ed-add5-ce6bcf3d1ae8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Jul 19 12:39:21.370614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 389/780] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:21.687871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:21.688521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:21.695707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:21.696160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:21.696948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:21.697423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:21.759067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:21.766469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b3c70a26-14d3-43d5-beaa-8c57074934ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082474 Jul 19 12:39:21.767068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 392/781] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:22.381817 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af40df04-dfab-4e3d-ae27-00a06c918469 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:22.382742 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af40df04-dfab-4e3d-ae27-00a06c918469 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:22.389134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af40df04-dfab-4e3d-ae27-00a06c918469 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:22.389587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af40df04-dfab-4e3d-ae27-00a06c918469 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:22.390877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af40df04-dfab-4e3d-ae27-00a06c918469 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:22.391318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af40df04-dfab-4e3d-ae27-00a06c918469 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:22.421038 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af40df04-dfab-4e3d-ae27-00a06c918469 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Jul 19 12:39:22.421601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 390/782] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:22.783473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:22.784093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:22.790558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:22.791017 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:22.791788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:22.792259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:22.852362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:22.859765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-edbe92a8-c78a-421b-89e5-28937475740f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080101 Jul 19 12:39:22.860374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 393/783] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:22 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:23.433116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b1595ff-8ac9-472e-a25e-6199756efffb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:23.434031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b1595ff-8ac9-472e-a25e-6199756efffb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:23.436401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=58 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:23.442135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b1595ff-8ac9-472e-a25e-6199756efffb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:23.442588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b1595ff-8ac9-472e-a25e-6199756efffb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:23.443382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b1595ff-8ac9-472e-a25e-6199756efffb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:23.444478 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b1595ff-8ac9-472e-a25e-6199756efffb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:23.472824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b1595ff-8ac9-472e-a25e-6199756efffb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Jul 19 12:39:23.473370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 391/784] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:23.876505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:23.877051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:23.883517 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:23.883968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:23.884783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:23.885220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:23.945393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:23.952645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-506ce850-75d5-4ad9-9db5-41e284b78f5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080277 Jul 19 12:39:23.953198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 394/785] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:23 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:24.485226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-907f051e-a811-4692-a578-d84d5f2febc4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:24.486157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-907f051e-a811-4692-a578-d84d5f2febc4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:24.492611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-907f051e-a811-4692-a578-d84d5f2febc4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:24.493068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-907f051e-a811-4692-a578-d84d5f2febc4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:24.493836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-907f051e-a811-4692-a578-d84d5f2febc4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:24.494272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-907f051e-a811-4692-a578-d84d5f2febc4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:24.523046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-907f051e-a811-4692-a578-d84d5f2febc4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041827 Jul 19 12:39:24.523586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 392/786] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:24.969540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:24.970067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:24.972390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:24.978667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:24.979122 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:24.979893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:24.980378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:25.042706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:25.050090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4e396edf-c707-4710-b9e0-e34932935929 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084508 Jul 19 12:39:25.050653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 395/787] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:24 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:25.534434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d15d565e-758d-4b7d-8a4f-da0abebacd02 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:25.535353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d15d565e-758d-4b7d-8a4f-da0abebacd02 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:25.543727 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d15d565e-758d-4b7d-8a4f-da0abebacd02 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:25.544588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d15d565e-758d-4b7d-8a4f-da0abebacd02 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:25.545778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d15d565e-758d-4b7d-8a4f-da0abebacd02 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:25.546227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d15d565e-758d-4b7d-8a4f-da0abebacd02 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:25.578130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d15d565e-758d-4b7d-8a4f-da0abebacd02 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047594 Jul 19 12:39:25.578676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 393/788] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:26.067377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:26.067938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:26.074271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:26.074746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:26.075768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:26.076225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:26.138612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:26.145935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-620af307-dd39-481c-a039-6f4a273da16f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082498 Jul 19 12:39:26.146989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 396/789] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:26 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:26.589851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2666ba40-e1b4-4c8d-af8f-53ff7ef69a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:26.590781 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2666ba40-e1b4-4c8d-af8f-53ff7ef69a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:26.597178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2666ba40-e1b4-4c8d-af8f-53ff7ef69a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:26.597625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2666ba40-e1b4-4c8d-af8f-53ff7ef69a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:26.598377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2666ba40-e1b4-4c8d-af8f-53ff7ef69a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:26.598807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2666ba40-e1b4-4c8d-af8f-53ff7ef69a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:26.627228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2666ba40-e1b4-4c8d-af8f-53ff7ef69a51 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 Jul 19 12:39:26.627723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 394/790] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:27.163170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:27.163766 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:27.170283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:27.170680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:27.171440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:27.171881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:27.231780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:27.239055 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-085bce06-60f8-436d-b769-0bdc042dd3ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079759 Jul 19 12:39:27.239622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 397/791] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:27 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:27.638612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a0c19d3-94b8-4c99-a2a7-d8dff184d7f0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:27.639560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4a0c19d3-94b8-4c99-a2a7-d8dff184d7f0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:27.645947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a0c19d3-94b8-4c99-a2a7-d8dff184d7f0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:27.646396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a0c19d3-94b8-4c99-a2a7-d8dff184d7f0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:27.647149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a0c19d3-94b8-4c99-a2a7-d8dff184d7f0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:27.647585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a0c19d3-94b8-4c99-a2a7-d8dff184d7f0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:27.675927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a0c19d3-94b8-4c99-a2a7-d8dff184d7f0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041248 Jul 19 12:39:27.676512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 395/792] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:28.256928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:28.257550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:28.263900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:28.264380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:28.265138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:28.265571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:28.325487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:28.334554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ba837106-40be-4d8d-8302-ba8dbf7f1c5e tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080905 Jul 19 12:39:28.335137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 398/793] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:28 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:28.687984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-073ea3bb-f4ee-4bc1-ba17-6327193403ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:28.688926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-073ea3bb-f4ee-4bc1-ba17-6327193403ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:28.696001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073ea3bb-f4ee-4bc1-ba17-6327193403ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:28.696481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073ea3bb-f4ee-4bc1-ba17-6327193403ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:28.697255 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073ea3bb-f4ee-4bc1-ba17-6327193403ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:28.697693 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073ea3bb-f4ee-4bc1-ba17-6327193403ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:28.726106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-073ea3bb-f4ee-4bc1-ba17-6327193403ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Jul 19 12:39:28.726658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 396/794] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:29.351368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:29.352000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:29.358516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:29.358973 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:29.359736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:29.360197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:29.421177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:29.428774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7e34995e-e216-456b-a9d2-39b8c92169dc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081880 Jul 19 12:39:29.429341 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 399/795] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:29 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:29.737618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f383d748-c1b8-4be1-b758-e19eb45acc96 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:29.738541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f383d748-c1b8-4be1-b758-e19eb45acc96 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:29.745018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f383d748-c1b8-4be1-b758-e19eb45acc96 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:29.745467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f383d748-c1b8-4be1-b758-e19eb45acc96 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:29.746229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f383d748-c1b8-4be1-b758-e19eb45acc96 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:29.746664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f383d748-c1b8-4be1-b758-e19eb45acc96 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:29.775793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f383d748-c1b8-4be1-b758-e19eb45acc96 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Jul 19 12:39:29.776355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 397/796] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:30.445154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:30.445680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:30.452021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:30.452499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:30.453259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:30.453693 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:30.517547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:30.524885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-84acd125-2aea-4616-82ba-8bb2b4ecb1ca tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083642 Jul 19 12:39:30.525443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 400/797] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:30 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:30.786855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8d2bcc6d-b685-4e19-98a5-6c9d108e58cb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:30.787777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8d2bcc6d-b685-4e19-98a5-6c9d108e58cb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:30.794155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d2bcc6d-b685-4e19-98a5-6c9d108e58cb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:30.794605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d2bcc6d-b685-4e19-98a5-6c9d108e58cb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:30.795366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d2bcc6d-b685-4e19-98a5-6c9d108e58cb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:30.795805 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d2bcc6d-b685-4e19-98a5-6c9d108e58cb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:30.824487 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8d2bcc6d-b685-4e19-98a5-6c9d108e58cb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 Jul 19 12:39:30.825024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 398/798] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:31.541363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:31.541980 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:31.548457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:31.548912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:31.549675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:31.550116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:31.608969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:31.617011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9c77eca2-fd2f-4b39-bdc3-2f8ab8df4335 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079447 Jul 19 12:39:31.617580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 401/799] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:31 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:31.836546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c270e4ef-c30a-4857-9da7-00d22120b5d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:31.837489 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c270e4ef-c30a-4857-9da7-00d22120b5d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:31.843887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c270e4ef-c30a-4857-9da7-00d22120b5d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:31.844378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c270e4ef-c30a-4857-9da7-00d22120b5d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:31.845130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c270e4ef-c30a-4857-9da7-00d22120b5d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:31.845559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c270e4ef-c30a-4857-9da7-00d22120b5d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:31.876607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c270e4ef-c30a-4857-9da7-00d22120b5d2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Jul 19 12:39:31.877157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 399/800] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:32.634123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:32.634732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:32.640801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:32.641250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:32.642002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:32.642441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:32.701262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:32.708630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-686a7d53-bbc0-424d-8357-dafd8ea3391f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.078818 Jul 19 12:39:32.709854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 402/801] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:32 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:32.888253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0b4d5c50-32e3-47b5-84ad-0effe9f1f0bd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:32.889097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0b4d5c50-32e3-47b5-84ad-0effe9f1f0bd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:32.895459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b4d5c50-32e3-47b5-84ad-0effe9f1f0bd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:32.895918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b4d5c50-32e3-47b5-84ad-0effe9f1f0bd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:32.896713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b4d5c50-32e3-47b5-84ad-0effe9f1f0bd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:32.897152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b4d5c50-32e3-47b5-84ad-0effe9f1f0bd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:32.920828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:32.926133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0b4d5c50-32e3-47b5-84ad-0effe9f1f0bd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Jul 19 12:39:32.926676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 400/802] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:33.726238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:33.726846 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:33.733318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:33.733803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:33.734563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:33.735001 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:33.795139 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:33.802499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a7e37c32-592e-4948-b866-55905086e728 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080701 Jul 19 12:39:33.803063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 403/803] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:33 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:33.938497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4e769873-8b00-466d-82b2-49e81b9d5865 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:33.939360 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4e769873-8b00-466d-82b2-49e81b9d5865 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:33.946309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e769873-8b00-466d-82b2-49e81b9d5865 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:33.946757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e769873-8b00-466d-82b2-49e81b9d5865 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:33.947509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e769873-8b00-466d-82b2-49e81b9d5865 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:33.947938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e769873-8b00-466d-82b2-49e81b9d5865 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:33.976332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4e769873-8b00-466d-82b2-49e81b9d5865 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Jul 19 12:39:33.976871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 401/804] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:34.818361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:34.818969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:34.825613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:34.826067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:34.826829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:34.827270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:34.889193 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:34.892537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:34.897614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2fa4b762-d93b-435f-bdfd-b7665d369809 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083170 Jul 19 12:39:34.898175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 404/805] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:34 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:34.987208 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40c37b84-b41a-4039-8a08-175bf9966ecb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:34.988206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40c37b84-b41a-4039-8a08-175bf9966ecb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:34.995260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40c37b84-b41a-4039-8a08-175bf9966ecb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:34.995716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40c37b84-b41a-4039-8a08-175bf9966ecb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:34.996515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40c37b84-b41a-4039-8a08-175bf9966ecb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:34.996958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40c37b84-b41a-4039-8a08-175bf9966ecb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:35.025535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40c37b84-b41a-4039-8a08-175bf9966ecb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042229 Jul 19 12:39:35.026080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 402/806] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:35.914129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:35.914682 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:35.921303 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:35.921758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:35.922523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:35.922963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:35.982462 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:35.989814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6404e1b5-627c-4cd3-9084-5751c55ea310 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079612 Jul 19 12:39:35.990870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 405/807] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:35 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:36.036381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1e52296a-c7cb-48f1-8020-2467a2f8954f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:36.037368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1e52296a-c7cb-48f1-8020-2467a2f8954f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:36.043816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e52296a-c7cb-48f1-8020-2467a2f8954f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:36.044330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e52296a-c7cb-48f1-8020-2467a2f8954f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:36.045092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e52296a-c7cb-48f1-8020-2467a2f8954f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:36.045564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e52296a-c7cb-48f1-8020-2467a2f8954f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:36.074813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1e52296a-c7cb-48f1-8020-2467a2f8954f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Jul 19 12:39:36.075465 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 403/808] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:39:37.007856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:37.008428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:37.014912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:37.015364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:37.016129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:37.016606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:37.076727 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:37.085066 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5d12436c-d392-43bf-8da0-1f72de8b86ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081771 Jul 19 12:39:37.085898 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 406/809] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:37 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:37.086467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0bea80c-36d4-4727-b79f-3aa2e6a7010a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:37.087496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0bea80c-36d4-4727-b79f-3aa2e6a7010a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:37.093832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0bea80c-36d4-4727-b79f-3aa2e6a7010a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:37.094282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0bea80c-36d4-4727-b79f-3aa2e6a7010a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:37.095046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0bea80c-36d4-4727-b79f-3aa2e6a7010a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:37.095510 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0bea80c-36d4-4727-b79f-3aa2e6a7010a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:37.123385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0bea80c-36d4-4727-b79f-3aa2e6a7010a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 Jul 19 12:39:37.124204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 404/810] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:39:38.102360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:38.103015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:38.109422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:38.109870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:38.110628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:38.111062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:38.134891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b956932-a1a4-403f-be4e-1219130eead0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:38.135807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b956932-a1a4-403f-be4e-1219130eead0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:38.142113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b956932-a1a4-403f-be4e-1219130eead0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:38.142555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b956932-a1a4-403f-be4e-1219130eead0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:38.143316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b956932-a1a4-403f-be4e-1219130eead0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:38.143744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b956932-a1a4-403f-be4e-1219130eead0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:38.173959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:38.174174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b956932-a1a4-403f-be4e-1219130eead0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 Jul 19 12:39:38.174745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 405/811] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:39:38.186944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d80b8cdb-6038-40e9-ade5-a5d27c2c08d4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088959 Jul 19 12:39:38.187531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 407/812] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:38 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:39.185647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc774b4c-9870-4fb1-8e20-4ef396894188 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:39.186561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc774b4c-9870-4fb1-8e20-4ef396894188 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:39.193618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc774b4c-9870-4fb1-8e20-4ef396894188 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:39.194065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc774b4c-9870-4fb1-8e20-4ef396894188 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:39.194827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc774b4c-9870-4fb1-8e20-4ef396894188 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:39.195257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc774b4c-9870-4fb1-8e20-4ef396894188 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:39.202703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:39.203439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:39.210112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:39.210558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:39.211318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:39.211755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:39.223741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc774b4c-9870-4fb1-8e20-4ef396894188 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Jul 19 12:39:39.225023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 406/813] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:39.279496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:39.287664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3134b2e7-3344-4aba-b40d-ce660222b0e2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088916 Jul 19 12:39:39.288240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 408/814] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:39 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:39:40.235677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6f4a794-10e3-4bfe-b21b-fe28ad312cf0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:40.236617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6f4a794-10e3-4bfe-b21b-fe28ad312cf0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:40.242975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6f4a794-10e3-4bfe-b21b-fe28ad312cf0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:40.243418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6f4a794-10e3-4bfe-b21b-fe28ad312cf0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:40.244193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6f4a794-10e3-4bfe-b21b-fe28ad312cf0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:40.244625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6f4a794-10e3-4bfe-b21b-fe28ad312cf0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:40.273303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6f4a794-10e3-4bfe-b21b-fe28ad312cf0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Jul 19 12:39:40.273840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 407/815] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:40.304653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:40.305268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:40.311632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:40.312085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:40.312881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:40.313321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:40.373012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:40.380658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b3cd544a-8248-42a5-8e8f-f85aaf285d7b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080418 Jul 19 12:39:40.381222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 409/816] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:40 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:41.283846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1bec14a4-25d2-411c-90e1-5c67f5c13022 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:41.284788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1bec14a4-25d2-411c-90e1-5c67f5c13022 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:41.291789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bec14a4-25d2-411c-90e1-5c67f5c13022 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:41.292260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bec14a4-25d2-411c-90e1-5c67f5c13022 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:41.293019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bec14a4-25d2-411c-90e1-5c67f5c13022 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:41.293450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bec14a4-25d2-411c-90e1-5c67f5c13022 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:41.322558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1bec14a4-25d2-411c-90e1-5c67f5c13022 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 Jul 19 12:39:41.323465 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 408/817] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:41.397547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:41.398158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:41.404552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:41.405007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:41.405771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:41.406211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:41.471507 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:41.478985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7a0a72b8-4f5d-46d8-a2de-ce91704234ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085804 Jul 19 12:39:41.479551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 410/818] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:41 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:42.334461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a8326e72-744e-45ca-9fc8-f8e5b43847eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:42.335371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a8326e72-744e-45ca-9fc8-f8e5b43847eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:42.341660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8326e72-744e-45ca-9fc8-f8e5b43847eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:42.342103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8326e72-744e-45ca-9fc8-f8e5b43847eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:42.342885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8326e72-744e-45ca-9fc8-f8e5b43847eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:42.343316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8326e72-744e-45ca-9fc8-f8e5b43847eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:42.371914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a8326e72-744e-45ca-9fc8-f8e5b43847eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Jul 19 12:39:42.372481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 409/819] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:42.496965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:42.497574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:42.504318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:42.504769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:42.505607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:42.506043 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:42.565592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:42.572832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-444b3678-fb62-4cb5-9c84-164a17b5ae2d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079724 Jul 19 12:39:42.573391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 411/820] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:42 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:43.383714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8daab774-9161-4e85-99cd-1af37a4071a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:43.384663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8daab774-9161-4e85-99cd-1af37a4071a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:43.391061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8daab774-9161-4e85-99cd-1af37a4071a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:43.391511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8daab774-9161-4e85-99cd-1af37a4071a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:43.392296 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8daab774-9161-4e85-99cd-1af37a4071a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:43.392732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8daab774-9161-4e85-99cd-1af37a4071a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:43.420197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8daab774-9161-4e85-99cd-1af37a4071a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041094 Jul 19 12:39:43.420745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 410/821] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:43.589553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:43.590164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:43.596630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:43.597092 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:43.597855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:43.598296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:43.664297 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:43.671885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a5ad204f-f7c5-4bab-8f55-e4a105898225 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.086155 Jul 19 12:39:43.672487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 412/822] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:43 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:44.431498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d7817a3f-352a-468f-a4fc-92479a90b8fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:44.432456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d7817a3f-352a-468f-a4fc-92479a90b8fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:44.439051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7817a3f-352a-468f-a4fc-92479a90b8fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:44.439502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7817a3f-352a-468f-a4fc-92479a90b8fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:44.440287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7817a3f-352a-468f-a4fc-92479a90b8fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:44.440723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7817a3f-352a-468f-a4fc-92479a90b8fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:44.468844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d7817a3f-352a-468f-a4fc-92479a90b8fd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 Jul 19 12:39:44.469381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 411/823] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:44.687964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:44.688557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:44.694975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:44.695431 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:44.696215 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:44.696663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:44.757512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:44.765032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-67f8eb5f-cdde-4925-bb31-d6d15e7e86f2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080989 Jul 19 12:39:44.765605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 413/824] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:44 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:45.480136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5cd171f7-abb8-4fc8-8877-8e510eaa1975 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:45.481072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5cd171f7-abb8-4fc8-8877-8e510eaa1975 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:45.487420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd171f7-abb8-4fc8-8877-8e510eaa1975 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:45.487865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd171f7-abb8-4fc8-8877-8e510eaa1975 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:45.488651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd171f7-abb8-4fc8-8877-8e510eaa1975 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:45.489079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd171f7-abb8-4fc8-8877-8e510eaa1975 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:45.517323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5cd171f7-abb8-4fc8-8877-8e510eaa1975 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040767 Jul 19 12:39:45.518548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 412/825] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:45.781722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:45.782260 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:45.789590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:45.790038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:45.790792 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:45.791229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:45.852562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:45.859962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dee89e7c-4adf-45a4-9736-6b2b28625070 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082173 Jul 19 12:39:45.860568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 414/826] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:45 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:46.530323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fbaf129e-6bea-4349-b8a5-187d1423b6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:46.531238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fbaf129e-6bea-4349-b8a5-187d1423b6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:46.537673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbaf129e-6bea-4349-b8a5-187d1423b6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:46.538119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbaf129e-6bea-4349-b8a5-187d1423b6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:46.538903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbaf129e-6bea-4349-b8a5-187d1423b6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:46.539333 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbaf129e-6bea-4349-b8a5-187d1423b6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:46.567197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fbaf129e-6bea-4349-b8a5-187d1423b6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040791 Jul 19 12:39:46.568416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 413/827] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:46.877699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:46.878228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:46.884625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:46.885085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:46.885849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:46.886287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:46.946489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:46.953848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-021190ce-bdb1-4c12-a1e1-37e58607dbcf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080373 Jul 19 12:39:46.954415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 415/828] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:46 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:47.579190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6d429d1-ab1b-4ff1-9006-e9c85c6207af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:47.580101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6d429d1-ab1b-4ff1-9006-e9c85c6207af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:47.587132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6d429d1-ab1b-4ff1-9006-e9c85c6207af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:47.587583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6d429d1-ab1b-4ff1-9006-e9c85c6207af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:47.588378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6d429d1-ab1b-4ff1-9006-e9c85c6207af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:47.588815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6d429d1-ab1b-4ff1-9006-e9c85c6207af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:47.617783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6d429d1-ab1b-4ff1-9006-e9c85c6207af tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 Jul 19 12:39:47.618351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 414/829] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:47.969820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:47.970403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:47.977359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:47.977810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:47.978569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:47.979012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:48.042191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:48.049621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7e0ae903-230e-41cb-8c15-addf09fa2ce3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083708 Jul 19 12:39:48.050182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 416/830] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:47 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:48.629588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a15aa382-3d6e-4c1a-8a89-a618517aab89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:48.631139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a15aa382-3d6e-4c1a-8a89-a618517aab89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:48.637727 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a15aa382-3d6e-4c1a-8a89-a618517aab89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:48.638175 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a15aa382-3d6e-4c1a-8a89-a618517aab89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:48.638939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a15aa382-3d6e-4c1a-8a89-a618517aab89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:48.639371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a15aa382-3d6e-4c1a-8a89-a618517aab89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:48.667181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a15aa382-3d6e-4c1a-8a89-a618517aab89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Jul 19 12:39:48.667723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 415/831] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:49.066542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:49.067190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:49.074221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:49.074677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:49.075442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:49.075883 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:49.135711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:49.143019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4fde231f-9ba7-4bba-945b-e82156586fb2 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080368 Jul 19 12:39:49.143576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 417/832] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:49 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:49.678684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f69369af-fca3-49e0-83a0-1746fe9e65d5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:49.679606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f69369af-fca3-49e0-83a0-1746fe9e65d5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:49.686034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f69369af-fca3-49e0-83a0-1746fe9e65d5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:49.686484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f69369af-fca3-49e0-83a0-1746fe9e65d5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:49.687245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f69369af-fca3-49e0-83a0-1746fe9e65d5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:49.687681 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f69369af-fca3-49e0-83a0-1746fe9e65d5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:49.718140 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f69369af-fca3-49e0-83a0-1746fe9e65d5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043815 Jul 19 12:39:49.718733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 416/833] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:50.159725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:50.160358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:50.166984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:50.167432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:50.168203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:50.168689 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:50.227922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:50.235232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f7997bc8-b8ed-4cdd-9cc6-055d38c3766f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079195 Jul 19 12:39:50.235790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 418/834] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:50 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:50.729755 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f3b0ce3-ea5e-4894-965d-ae5c0e12e324 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:50.730697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f3b0ce3-ea5e-4894-965d-ae5c0e12e324 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:50.737172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f3b0ce3-ea5e-4894-965d-ae5c0e12e324 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:50.737621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f3b0ce3-ea5e-4894-965d-ae5c0e12e324 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:50.738378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f3b0ce3-ea5e-4894-965d-ae5c0e12e324 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:50.738841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f3b0ce3-ea5e-4894-965d-ae5c0e12e324 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:50.755681 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:50.768740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f3b0ce3-ea5e-4894-965d-ae5c0e12e324 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Jul 19 12:39:50.769393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 417/835] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:51.251555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:51.252264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:51.258564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:51.259019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:51.259784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:51.260245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:51.320522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:51.327971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-32f8365c-0bb2-4c21-ab45-a8c95af988ac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080453 Jul 19 12:39:51.328805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 419/836] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:51 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:51.780924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a86daf7-73cc-40e4-9781-7b773e257d9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:51.781868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a86daf7-73cc-40e4-9781-7b773e257d9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:51.788261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a86daf7-73cc-40e4-9781-7b773e257d9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:51.788711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a86daf7-73cc-40e4-9781-7b773e257d9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:51.789461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a86daf7-73cc-40e4-9781-7b773e257d9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:51.789895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a86daf7-73cc-40e4-9781-7b773e257d9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:51.818378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a86daf7-73cc-40e4-9781-7b773e257d9f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040797 Jul 19 12:39:51.818909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 418/837] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:52.345941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:52.346548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:52.353759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:52.354212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:52.354972 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:52.355432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:52.419681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:52.427470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-248084fb-011a-42fc-ae18-923846dca63d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085411 Jul 19 12:39:52.428036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 420/838] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:52 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:52.829563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1406c57e-d587-435c-9586-05fbc1893ee0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:52.830477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1406c57e-d587-435c-9586-05fbc1893ee0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:52.836859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1406c57e-d587-435c-9586-05fbc1893ee0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:52.837309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1406c57e-d587-435c-9586-05fbc1893ee0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:52.838056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1406c57e-d587-435c-9586-05fbc1893ee0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:52.838490 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1406c57e-d587-435c-9586-05fbc1893ee0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:52.866974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1406c57e-d587-435c-9586-05fbc1893ee0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Jul 19 12:39:52.867505 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 419/839] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:53.444363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:53.444971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:53.451591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:53.452053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:53.452885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:53.453334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:53.471812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:53.515528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:53.523654 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4cb44dce-9adf-4d12-ba01-c4767f4e8028 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083734 Jul 19 12:39:53.524241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 421/840] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:53 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:53.878803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6c3e5bc-6448-4a83-abf6-c69601659560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:53.879724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6c3e5bc-6448-4a83-abf6-c69601659560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:53.882604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=58 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:53.887780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c3e5bc-6448-4a83-abf6-c69601659560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:53.888259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c3e5bc-6448-4a83-abf6-c69601659560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:53.889051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c3e5bc-6448-4a83-abf6-c69601659560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:53.889482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c3e5bc-6448-4a83-abf6-c69601659560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:53.917365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6c3e5bc-6448-4a83-abf6-c69601659560 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042487 Jul 19 12:39:53.917902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 420/841] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:54.540847 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:54.541464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:54.547895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:54.548390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:54.549166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:54.549610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:54.609649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:54.617142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2a7efa38-a1ac-417e-85ff-f7caa8fa9802 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080796 Jul 19 12:39:54.617701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 422/842] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:54 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:54.928841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d90a2b84-2151-4497-8770-fde703279fba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:54.929675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d90a2b84-2151-4497-8770-fde703279fba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:54.936091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d90a2b84-2151-4497-8770-fde703279fba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:54.936568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d90a2b84-2151-4497-8770-fde703279fba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:54.937323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d90a2b84-2151-4497-8770-fde703279fba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:54.937756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d90a2b84-2151-4497-8770-fde703279fba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:54.966392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d90a2b84-2151-4497-8770-fde703279fba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041599 Jul 19 12:39:54.966924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 421/843] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:55.634428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:55.635096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:55.637423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:55.642647 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:55.643096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:55.643861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:55.644330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:55.705959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:55.713363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-23e7058b-df61-4581-8dd5-538300318ec4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083440 Jul 19 12:39:55.713922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 423/844] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:55 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:55.978169 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-61147920-6861-4ccb-af7d-4d4b99acf07a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:55.979093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-61147920-6861-4ccb-af7d-4d4b99acf07a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:55.985604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61147920-6861-4ccb-af7d-4d4b99acf07a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:55.986060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61147920-6861-4ccb-af7d-4d4b99acf07a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:55.986830 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61147920-6861-4ccb-af7d-4d4b99acf07a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:55.987273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61147920-6861-4ccb-af7d-4d4b99acf07a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:56.019021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-61147920-6861-4ccb-af7d-4d4b99acf07a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Jul 19 12:39:56.019580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 422/845] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:56.729834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:56.730456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:56.737072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:56.737533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:56.738300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:56.738771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:56.802564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:56.809935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-27540de5-934d-4afd-93e4-9efcbce7984c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084086 Jul 19 12:39:56.810497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 424/846] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:56 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:57.030642 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ef486c6e-535c-4c51-ac36-df1b11e59d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:57.031508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ef486c6e-535c-4c51-ac36-df1b11e59d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:57.037942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef486c6e-535c-4c51-ac36-df1b11e59d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:57.038390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef486c6e-535c-4c51-ac36-df1b11e59d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:57.039143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef486c6e-535c-4c51-ac36-df1b11e59d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:57.039574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef486c6e-535c-4c51-ac36-df1b11e59d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:57.067978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ef486c6e-535c-4c51-ac36-df1b11e59d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040832 Jul 19 12:39:57.068541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 423/847] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:57.826838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:57.827448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:57.834306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:57.834748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:57.835497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:57.835928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:57.895910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:57.903218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-94759646-a66c-4652-9a63-dbe89313f9ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080216 Jul 19 12:39:57.903773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 425/848] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:57 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:58.079209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-873e3f19-15d1-4822-ab40-f678b03d7431 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:58.080131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-873e3f19-15d1-4822-ab40-f678b03d7431 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:58.087102 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-873e3f19-15d1-4822-ab40-f678b03d7431 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:58.087555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-873e3f19-15d1-4822-ab40-f678b03d7431 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:58.088345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-873e3f19-15d1-4822-ab40-f678b03d7431 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:58.088779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-873e3f19-15d1-4822-ab40-f678b03d7431 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:58.117048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-873e3f19-15d1-4822-ab40-f678b03d7431 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041709 Jul 19 12:39:58.117597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 424/849] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:39:58.920369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:58.920912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:58.927282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:58.927729 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:58.928507 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:58.928941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:58.990117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:39:58.997434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-feca7bd3-b7db-444f-8770-9c9312eba5bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081100 Jul 19 12:39:58.997996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 426/850] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:39:58 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:39:59.128591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5a12be3b-06f6-486c-a93e-80b47cb94919 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:39:59.129500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5a12be3b-06f6-486c-a93e-80b47cb94919 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:39:59.136386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a12be3b-06f6-486c-a93e-80b47cb94919 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:59.136833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a12be3b-06f6-486c-a93e-80b47cb94919 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:59.137588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a12be3b-06f6-486c-a93e-80b47cb94919 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:39:59.138021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a12be3b-06f6-486c-a93e-80b47cb94919 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:39:59.166640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5a12be3b-06f6-486c-a93e-80b47cb94919 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Jul 19 12:39:59.167188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 425/851] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:39:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:00.014434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:00.015040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:00.021443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:00.021897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:00.022652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:00.023088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:00.082526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:00.090215 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-08b904c2-8410-490f-a0ca-0b7ade3afe89 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079682 Jul 19 12:40:00.090826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 427/852] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:00 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:00.178495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f73e29f-cd26-4421-a9f4-2f45d7dc48c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:00.179444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f73e29f-cd26-4421-a9f4-2f45d7dc48c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:00.185795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f73e29f-cd26-4421-a9f4-2f45d7dc48c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:00.186240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f73e29f-cd26-4421-a9f4-2f45d7dc48c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:00.186998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f73e29f-cd26-4421-a9f4-2f45d7dc48c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:00.187431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f73e29f-cd26-4421-a9f4-2f45d7dc48c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:00.216096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f73e29f-cd26-4421-a9f4-2f45d7dc48c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042043 Jul 19 12:40:00.216687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 426/853] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:01.106696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:01.107304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:01.113753 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:01.114240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:01.115533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:01.115971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:01.178508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:01.185809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-26ea577d-ba20-4da3-b4b4-35d2a6e4f21b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082974 Jul 19 12:40:01.186369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 428/854] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:01 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:01.227436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75d1f23c-e7ff-42cc-949d-18cb99167ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:01.228405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75d1f23c-e7ff-42cc-949d-18cb99167ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:01.234297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d1f23c-e7ff-42cc-949d-18cb99167ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:01.234742 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d1f23c-e7ff-42cc-949d-18cb99167ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:01.235491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d1f23c-e7ff-42cc-949d-18cb99167ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:01.235929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d1f23c-e7ff-42cc-949d-18cb99167ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:01.264054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75d1f23c-e7ff-42cc-949d-18cb99167ba7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041396 Jul 19 12:40:01.264616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 427/855] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:02.204284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:02.204902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:02.211056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:02.211513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:02.212314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:02.212756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:02.273094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:02.275087 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-06e9c464-de91-49d1-97a3-bea2b8e51315 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:02.276100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-06e9c464-de91-49d1-97a3-bea2b8e51315 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:02.280570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-38bbc7f4-f4de-400f-85a3-e7f045dc56fc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080286 Jul 19 12:40:02.281139 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 429/856] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:02 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:02.282579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06e9c464-de91-49d1-97a3-bea2b8e51315 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:02.283099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06e9c464-de91-49d1-97a3-bea2b8e51315 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:02.283900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06e9c464-de91-49d1-97a3-bea2b8e51315 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:02.284366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06e9c464-de91-49d1-97a3-bea2b8e51315 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:02.312480 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-06e9c464-de91-49d1-97a3-bea2b8e51315 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041468 Jul 19 12:40:02.313021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 428/857] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:40:03.296326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:03.296939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:03.303401 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:03.303849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:03.304648 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:03.305082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:03.324416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c19d21f5-d608-4e02-b363-df78c1f12289 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:03.325370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c19d21f5-d608-4e02-b363-df78c1f12289 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:03.331705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19d21f5-d608-4e02-b363-df78c1f12289 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:03.332160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19d21f5-d608-4e02-b363-df78c1f12289 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:03.333005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19d21f5-d608-4e02-b363-df78c1f12289 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:03.333971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19d21f5-d608-4e02-b363-df78c1f12289 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:03.362409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c19d21f5-d608-4e02-b363-df78c1f12289 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041885 Jul 19 12:40:03.363193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 429/858] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:40:03.365955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:03.373371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9a2e42c7-99d9-4ea0-8e40-625e664dfa5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080902 Jul 19 12:40:03.374183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 430/859] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:04.373110 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb9f3dde-dcef-4989-9ce2-04d554e54d30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:04.374290 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb9f3dde-dcef-4989-9ce2-04d554e54d30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:04.381272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb9f3dde-dcef-4989-9ce2-04d554e54d30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:04.381719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb9f3dde-dcef-4989-9ce2-04d554e54d30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:04.382471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb9f3dde-dcef-4989-9ce2-04d554e54d30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:04.382905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb9f3dde-dcef-4989-9ce2-04d554e54d30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:04.390347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:04.390967 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:04.397388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:04.397838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:04.398603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:04.399073 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:04.411247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb9f3dde-dcef-4989-9ce2-04d554e54d30 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Jul 19 12:40:04.411801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 430/860] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:04.459225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:04.466639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-624ee9c9-dbc2-4a95-96c4-583321072952 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080077 Jul 19 12:40:04.467210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 431/861] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:04 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:05.422792 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30edee19-cf91-4ddf-a3a6-e4b0081d6404 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:05.423714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30edee19-cf91-4ddf-a3a6-e4b0081d6404 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:05.430268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30edee19-cf91-4ddf-a3a6-e4b0081d6404 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:05.430719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30edee19-cf91-4ddf-a3a6-e4b0081d6404 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:05.431485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30edee19-cf91-4ddf-a3a6-e4b0081d6404 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:05.431952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30edee19-cf91-4ddf-a3a6-e4b0081d6404 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:05.460577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30edee19-cf91-4ddf-a3a6-e4b0081d6404 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Jul 19 12:40:05.461121 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 431/862] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:05.482675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:05.483291 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:05.489701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:05.490156 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:05.490919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:05.491358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:05.553278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:05.560540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b2232cf7-f471-4e33-8b25-e19331e34e7f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081707 Jul 19 12:40:05.561105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 432/863] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:05 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:06.471690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9f4fa39e-14fe-4319-9a70-2250a438347c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:06.472665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f4fa39e-14fe-4319-9a70-2250a438347c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:06.479049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f4fa39e-14fe-4319-9a70-2250a438347c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:06.479503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f4fa39e-14fe-4319-9a70-2250a438347c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:06.480299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f4fa39e-14fe-4319-9a70-2250a438347c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:06.480737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f4fa39e-14fe-4319-9a70-2250a438347c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:06.508872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9f4fa39e-14fe-4319-9a70-2250a438347c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041196 Jul 19 12:40:06.509421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 432/864] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:06.577282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:06.577903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:06.584639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:06.585091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:06.585851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:06.586287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:06.648378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:06.658111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c51f1c4f-5661-4de2-84ed-ab3a989ec308 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084643 Jul 19 12:40:06.658690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 433/865] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:07.520833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1cfb233a-7f4c-44a1-bf89-e4b644def0d7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:07.521801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1cfb233a-7f4c-44a1-bf89-e4b644def0d7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:07.528145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cfb233a-7f4c-44a1-bf89-e4b644def0d7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:07.528620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cfb233a-7f4c-44a1-bf89-e4b644def0d7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:07.529394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cfb233a-7f4c-44a1-bf89-e4b644def0d7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:07.529809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cfb233a-7f4c-44a1-bf89-e4b644def0d7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:07.557793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1cfb233a-7f4c-44a1-bf89-e4b644def0d7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Jul 19 12:40:07.558329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 433/866] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:07.675481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:07.676132 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:07.682653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:07.683104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:07.683862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:07.684323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:07.745737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:07.753293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7d2d1fa5-a867-4729-baab-e71cc8d881f6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082378 Jul 19 12:40:07.753845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 434/867] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:08.333141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:40:08.333403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:40:08.569719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52f00904-34cd-4ed2-af21-e7b5e098e917 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:08.570664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52f00904-34cd-4ed2-af21-e7b5e098e917 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:08.577088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f00904-34cd-4ed2-af21-e7b5e098e917 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:08.577535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f00904-34cd-4ed2-af21-e7b5e098e917 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:08.578293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f00904-34cd-4ed2-af21-e7b5e098e917 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:08.578737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f00904-34cd-4ed2-af21-e7b5e098e917 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:08.582329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:08.608638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52f00904-34cd-4ed2-af21-e7b5e098e917 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Jul 19 12:40:08.612340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 434/868] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:08.770232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:08.771487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:08.777931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:08.778379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:08.779135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:08.779570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:08.839762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:08.847049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-17fe0705-4e16-4756-9328-d23c667685a3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080810 Jul 19 12:40:08.847599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 435/869] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:08 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:09.620061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-606997bf-ae59-4fee-914b-9524b62f5e8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:09.621014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-606997bf-ae59-4fee-914b-9524b62f5e8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:09.627616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606997bf-ae59-4fee-914b-9524b62f5e8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:09.628063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606997bf-ae59-4fee-914b-9524b62f5e8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:09.628866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606997bf-ae59-4fee-914b-9524b62f5e8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:09.629301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606997bf-ae59-4fee-914b-9524b62f5e8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:09.657551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-606997bf-ae59-4fee-914b-9524b62f5e8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Jul 19 12:40:09.658094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 435/870] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:09.863339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:09.863954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:09.870449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:09.870898 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:09.871695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:09.872135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:09.934224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:09.941582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-22811cc6-2b3f-4360-9fc9-0d0afdae9ebb tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082281 Jul 19 12:40:09.942677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 436/871] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:09 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:10.668827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fde9ef0f-061d-4a93-8890-6590572a4033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:10.669770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fde9ef0f-061d-4a93-8890-6590572a4033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:10.676102 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fde9ef0f-061d-4a93-8890-6590572a4033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:10.677097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fde9ef0f-061d-4a93-8890-6590572a4033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:10.677847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fde9ef0f-061d-4a93-8890-6590572a4033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:10.678276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fde9ef0f-061d-4a93-8890-6590572a4033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:10.707289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fde9ef0f-061d-4a93-8890-6590572a4033 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jul 19 12:40:10.707894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 436/872] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:10.958637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:10.959172 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:10.965649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:10.966101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:10.966863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:10.967302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:11.027200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:11.034538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a249b4f2-b905-4239-9ef0-9b98833312ea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079798 Jul 19 12:40:11.035103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 437/873] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:10 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:11.718661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-60e0f5ba-a542-4019-9e8c-91890d155f84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:11.719603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-60e0f5ba-a542-4019-9e8c-91890d155f84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:11.726316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e0f5ba-a542-4019-9e8c-91890d155f84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:11.726848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e0f5ba-a542-4019-9e8c-91890d155f84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:11.727716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e0f5ba-a542-4019-9e8c-91890d155f84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:11.728303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e0f5ba-a542-4019-9e8c-91890d155f84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:11.757889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-60e0f5ba-a542-4019-9e8c-91890d155f84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043134 Jul 19 12:40:11.758436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 437/874] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:12.051821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:12.052451 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:12.058814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:12.059262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:12.060019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:12.060486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:12.064382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:12.120431 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:12.127933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5016aff1-e634-4f48-8652-a210a7ba4459 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080491 Jul 19 12:40:12.128524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 438/875] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:12 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:12.769459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f18330db-d833-4e22-b7de-3662808a53ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:12.770890 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f18330db-d833-4e22-b7de-3662808a53ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:12.777498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f18330db-d833-4e22-b7de-3662808a53ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:12.778081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f18330db-d833-4e22-b7de-3662808a53ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:12.779115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f18330db-d833-4e22-b7de-3662808a53ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:12.779876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f18330db-d833-4e22-b7de-3662808a53ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:12.810290 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f18330db-d833-4e22-b7de-3662808a53ad tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Jul 19 12:40:12.810843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 438/876] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:13.145631 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:13.146236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:13.152759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:13.153214 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:13.153983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:13.154422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:13.214189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:13.221592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-103ed95f-9839-4ec7-8f2b-5ec371e3ae00 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080440 Jul 19 12:40:13.222159 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 439/877] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:13.822151 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-274a9dfe-0c9a-4bf3-916b-29806dc46058 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:13.823128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-274a9dfe-0c9a-4bf3-916b-29806dc46058 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:13.829562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-274a9dfe-0c9a-4bf3-916b-29806dc46058 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:13.830010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-274a9dfe-0c9a-4bf3-916b-29806dc46058 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:13.830763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-274a9dfe-0c9a-4bf3-916b-29806dc46058 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:13.831211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-274a9dfe-0c9a-4bf3-916b-29806dc46058 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:13.862233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-274a9dfe-0c9a-4bf3-916b-29806dc46058 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043992 Jul 19 12:40:13.862785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 439/878] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:14.238210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:14.239462 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:14.246240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:14.246704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:14.247479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:14.247923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:14.312353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:14.319779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-008d5bc9-0542-4049-8485-12cee4b6666c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085704 Jul 19 12:40:14.320367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 440/879] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:14.874772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e33b914b-18c5-48d1-bfcb-3804f8e77c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:14.875654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e33b914b-18c5-48d1-bfcb-3804f8e77c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:14.882689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e33b914b-18c5-48d1-bfcb-3804f8e77c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:14.883142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e33b914b-18c5-48d1-bfcb-3804f8e77c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:14.883901 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e33b914b-18c5-48d1-bfcb-3804f8e77c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:14.884361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e33b914b-18c5-48d1-bfcb-3804f8e77c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:14.911782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e33b914b-18c5-48d1-bfcb-3804f8e77c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041321 Jul 19 12:40:14.912352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 440/880] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:15.336091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:15.336733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:15.343273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:15.343763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:15.344562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:15.345003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:15.405507 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:15.412900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b945c7bc-3d15-468f-bf7f-bd1e4231ad36 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081161 Jul 19 12:40:15.413464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 441/881] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:15 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:15.923273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4425def2-70b9-46d3-aaf0-a4726fbb9b11 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:15.924223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4425def2-70b9-46d3-aaf0-a4726fbb9b11 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:15.933609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4425def2-70b9-46d3-aaf0-a4726fbb9b11 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:15.934062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4425def2-70b9-46d3-aaf0-a4726fbb9b11 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:15.934859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4425def2-70b9-46d3-aaf0-a4726fbb9b11 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:15.935417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4425def2-70b9-46d3-aaf0-a4726fbb9b11 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:15.963764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4425def2-70b9-46d3-aaf0-a4726fbb9b11 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Jul 19 12:40:15.964347 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 441/882] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:16.429780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:16.430413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:16.436793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:16.437239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:16.437996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:16.438429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:16.499904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:16.507893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-25f0e18b-d0fe-4181-bd0c-982b4ade9f8a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082658 Jul 19 12:40:16.508488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 442/883] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:16 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:16.974965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7dcdb174-717f-40ec-8c81-8f83787fceaa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:16.975878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7dcdb174-717f-40ec-8c81-8f83787fceaa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:16.982310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dcdb174-717f-40ec-8c81-8f83787fceaa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:16.982718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dcdb174-717f-40ec-8c81-8f83787fceaa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:16.983444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dcdb174-717f-40ec-8c81-8f83787fceaa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:16.983874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dcdb174-717f-40ec-8c81-8f83787fceaa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:17.011938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7dcdb174-717f-40ec-8c81-8f83787fceaa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040993 Jul 19 12:40:17.012518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 442/884] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:17.524813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:17.525536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:17.531944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:17.532413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:17.533173 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:17.533609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:17.596335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:17.603716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-da26ef91-4889-423f-8fb0-356031ca8d26 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083376 Jul 19 12:40:17.604297 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 443/885] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:18.022978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8c7239c-0af3-4d25-8332-711da4354d99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:18.023894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8c7239c-0af3-4d25-8332-711da4354d99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:18.030339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c7239c-0af3-4d25-8332-711da4354d99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:18.030787 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c7239c-0af3-4d25-8332-711da4354d99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:18.031539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c7239c-0af3-4d25-8332-711da4354d99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:18.031971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c7239c-0af3-4d25-8332-711da4354d99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:18.059771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8c7239c-0af3-4d25-8332-711da4354d99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040786 Jul 19 12:40:18.060388 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 443/886] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:18.620726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:18.621444 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:18.628445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:18.628902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:18.629671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:18.630115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:18.690432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:18.698435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f34c167b-1006-4b8c-8b51-c2bc05280629 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081671 Jul 19 12:40:18.698997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 444/887] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:19.071106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22c3ab66-2709-4741-99dd-c390b1c526c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:19.072019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22c3ab66-2709-4741-99dd-c390b1c526c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:19.078979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22c3ab66-2709-4741-99dd-c390b1c526c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:19.079422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22c3ab66-2709-4741-99dd-c390b1c526c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:19.080203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22c3ab66-2709-4741-99dd-c390b1c526c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:19.080645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22c3ab66-2709-4741-99dd-c390b1c526c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:19.108654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22c3ab66-2709-4741-99dd-c390b1c526c1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041415 Jul 19 12:40:19.109197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 444/888] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:19.715052 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:19.715660 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:19.722371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:19.722821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:19.723579 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:19.724014 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:19.785360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:19.792709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-df0ab622-eeff-448f-89d3-7a2ab98e52bd tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081847 Jul 19 12:40:19.793292 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 445/889] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:20.121590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b76a5f0d-4dbe-4c91-9113-6e73ae677525 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:20.122456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b76a5f0d-4dbe-4c91-9113-6e73ae677525 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:20.129044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b76a5f0d-4dbe-4c91-9113-6e73ae677525 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:20.129488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b76a5f0d-4dbe-4c91-9113-6e73ae677525 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:20.130240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b76a5f0d-4dbe-4c91-9113-6e73ae677525 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:20.131341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b76a5f0d-4dbe-4c91-9113-6e73ae677525 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:20.158738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b76a5f0d-4dbe-4c91-9113-6e73ae677525 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041469 Jul 19 12:40:20.159281 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 445/890] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:20.809288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:20.809899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:20.816256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:20.816713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:20.817464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:20.817896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:20.880421 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:20.888389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ff4ec4e8-18df-4ee3-a7f1-a549ea9734d8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082911 Jul 19 12:40:20.888966 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 446/891] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:21.170280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-33c6ebc2-f0a0-42ba-a86f-d599fcbcc639 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:21.171141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-33c6ebc2-f0a0-42ba-a86f-d599fcbcc639 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:21.178248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33c6ebc2-f0a0-42ba-a86f-d599fcbcc639 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:21.178695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33c6ebc2-f0a0-42ba-a86f-d599fcbcc639 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:21.179457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33c6ebc2-f0a0-42ba-a86f-d599fcbcc639 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:21.179892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33c6ebc2-f0a0-42ba-a86f-d599fcbcc639 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:21.207573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-33c6ebc2-f0a0-42ba-a86f-d599fcbcc639 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Jul 19 12:40:21.208118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 446/892] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:21.904211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:21.904842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:21.911193 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:21.912151 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:21.912937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:21.913374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:21.975255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:21.982618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ace058a7-572c-4994-a1a9-377fbeaf9dbf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082351 Jul 19 12:40:21.983177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 447/893] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:22.219146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6cf94d00-5089-470d-8ca5-9329d091c928 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:22.219993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6cf94d00-5089-470d-8ca5-9329d091c928 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:22.226946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf94d00-5089-470d-8ca5-9329d091c928 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:22.227390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf94d00-5089-470d-8ca5-9329d091c928 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:22.228146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf94d00-5089-470d-8ca5-9329d091c928 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:22.228605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf94d00-5089-470d-8ca5-9329d091c928 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:22.256620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6cf94d00-5089-470d-8ca5-9329d091c928 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041502 Jul 19 12:40:22.257155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 447/894] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:22.629061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:22.629591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:22.636013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:22.636500 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:22.637267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:22.637835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:23.000239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:23.000856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:23.006790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:23.007244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:23.008010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:23.008473 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:23.068532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:23.076592 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77628a88-f8c4-46de-9699-220eb35b1dd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081049 Jul 19 12:40:23.077147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 448/895] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:22 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:23.267639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1f88780a-b825-42c3-bf1e-e98011c2c6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:23.268503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1f88780a-b825-42c3-bf1e-e98011c2c6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:23.274836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f88780a-b825-42c3-bf1e-e98011c2c6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:23.275285 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f88780a-b825-42c3-bf1e-e98011c2c6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:23.276046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f88780a-b825-42c3-bf1e-e98011c2c6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:23.276515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f88780a-b825-42c3-bf1e-e98011c2c6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:23.305394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1f88780a-b825-42c3-bf1e-e98011c2c6bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Jul 19 12:40:23.305952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 449/896] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:40:24.093373 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:24.093982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:24.095844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=60 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:24.102089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:24.102543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:24.103306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:24.103739 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:24.163259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:24.166626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:24.171423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-915dc5cc-851b-43fe-ad71-cc3a5d9873ae tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081906 Jul 19 12:40:24.171981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 450/897] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:24 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:24.317022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-70672c7a-e9ad-454e-a0de-16f914edd2aa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:24.318445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-70672c7a-e9ad-454e-a0de-16f914edd2aa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:24.325028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70672c7a-e9ad-454e-a0de-16f914edd2aa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:24.325481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70672c7a-e9ad-454e-a0de-16f914edd2aa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:24.326245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70672c7a-e9ad-454e-a0de-16f914edd2aa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:24.326693 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70672c7a-e9ad-454e-a0de-16f914edd2aa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:24.361656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-70672c7a-e9ad-454e-a0de-16f914edd2aa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048159 Jul 19 12:40:24.362639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 451/898] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:25.186743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:25.187356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:25.193854 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:25.194303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:25.195063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:25.195500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:25.254851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:25.262677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5565ab1-3c77-41a9-ba33-9a3c6f7ea4a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079761 Jul 19 12:40:25.263239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 452/899] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:25 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:25.373385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0512d3d0-3caf-418e-89d6-c2dc24aefb8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:25.374582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0512d3d0-3caf-418e-89d6-c2dc24aefb8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:25.381634 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0512d3d0-3caf-418e-89d6-c2dc24aefb8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:25.382088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0512d3d0-3caf-418e-89d6-c2dc24aefb8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:25.382854 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0512d3d0-3caf-418e-89d6-c2dc24aefb8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:25.383295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0512d3d0-3caf-418e-89d6-c2dc24aefb8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:25.414191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0512d3d0-3caf-418e-89d6-c2dc24aefb8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Jul 19 12:40:25.414749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 453/900] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:40:26.279803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:26.280448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:26.286698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:26.287155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:26.287930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:26.288419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:26.353066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:26.360768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f638a8d1-dfd9-443f-9a19-593f5b9f3a9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084754 Jul 19 12:40:26.361340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 454/901] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:26 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:26.425711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1fb200a4-ad72-436e-af41-0b9f5848e3df tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:26.426670 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1fb200a4-ad72-436e-af41-0b9f5848e3df tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:26.433659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fb200a4-ad72-436e-af41-0b9f5848e3df tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:26.434112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fb200a4-ad72-436e-af41-0b9f5848e3df tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:26.434878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fb200a4-ad72-436e-af41-0b9f5848e3df tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:26.435318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fb200a4-ad72-436e-af41-0b9f5848e3df tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:26.463081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1fb200a4-ad72-436e-af41-0b9f5848e3df tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 Jul 19 12:40:26.463621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 455/902] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:40:27.378088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:27.378692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:27.385162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:27.385612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:27.386370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:27.386802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:27.447517 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:27.454860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a1c2038-c790-4415-93ed-0ad16a4efcac tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080722 Jul 19 12:40:27.455410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 456/903] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:27 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:27.473900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32a71255-ec8c-4e7e-ba71-14a62f3882d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:27.474796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32a71255-ec8c-4e7e-ba71-14a62f3882d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:27.480397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a71255-ec8c-4e7e-ba71-14a62f3882d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:27.480842 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a71255-ec8c-4e7e-ba71-14a62f3882d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:27.481596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a71255-ec8c-4e7e-ba71-14a62f3882d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:27.482025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a71255-ec8c-4e7e-ba71-14a62f3882d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:27.510876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32a71255-ec8c-4e7e-ba71-14a62f3882d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040493 Jul 19 12:40:27.511412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 457/904] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:40:28.470671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:28.471295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:28.478294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:28.478748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:28.479514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:28.479953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:28.539424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:28.546794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f27fa913-0858-42be-afe4-2677ed5e6b9b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079932 Jul 19 12:40:28.547351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 458/905] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:28 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:28.551828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-661e7454-8130-4589-a84a-e6ad9c1c4a2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:28.553317 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-661e7454-8130-4589-a84a-e6ad9c1c4a2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:28.558885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-661e7454-8130-4589-a84a-e6ad9c1c4a2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:28.559337 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-661e7454-8130-4589-a84a-e6ad9c1c4a2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:28.560098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-661e7454-8130-4589-a84a-e6ad9c1c4a2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:28.560561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-661e7454-8130-4589-a84a-e6ad9c1c4a2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:28.587628 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-661e7454-8130-4589-a84a-e6ad9c1c4a2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039266 Jul 19 12:40:28.588099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 459/906] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:29.563805 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:29.564486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:29.571312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:29.571759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:29.572532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:29.572964 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:29.633968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:29.641378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22976a80-56a1-4630-b636-6ad471145bd0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081358 Jul 19 12:40:29.641935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 460/907] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:29 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:29.646380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-405c1ac1-8f61-41a9-924a-ac8df5366995 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:29.647274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-405c1ac1-8f61-41a9-924a-ac8df5366995 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:29.652803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-405c1ac1-8f61-41a9-924a-ac8df5366995 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:29.653251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-405c1ac1-8f61-41a9-924a-ac8df5366995 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:29.654006 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-405c1ac1-8f61-41a9-924a-ac8df5366995 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:29.654436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-405c1ac1-8f61-41a9-924a-ac8df5366995 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:29.683485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-405c1ac1-8f61-41a9-924a-ac8df5366995 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040562 Jul 19 12:40:29.684028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 461/908] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:30.658042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:30.658664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:30.665141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:30.665590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:30.666351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:30.666786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:30.729209 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:30.736641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d958f227-cba0-4687-af37-047bd9e9ce59 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082321 Jul 19 12:40:30.737202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 462/909] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:30 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:30.741665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2ecccfee-2cd8-4e66-990e-bc323dfa11ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:30.742565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2ecccfee-2cd8-4e66-990e-bc323dfa11ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:30.748064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ecccfee-2cd8-4e66-990e-bc323dfa11ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:30.748801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ecccfee-2cd8-4e66-990e-bc323dfa11ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:30.749563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ecccfee-2cd8-4e66-990e-bc323dfa11ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:30.750003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ecccfee-2cd8-4e66-990e-bc323dfa11ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:30.780250 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2ecccfee-2cd8-4e66-990e-bc323dfa11ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Jul 19 12:40:30.780810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 463/910] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:31.754054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:31.754712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:31.761377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:31.761827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:31.762582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:31.763011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:31.821783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:31.829144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47796444-f41f-4934-bf31-3bcbe63fce01 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079063 Jul 19 12:40:31.829700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 464/911] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:31 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:31.834076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-87f6cc19-9b02-4c6f-8b72-8d403b753163 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:31.834975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-87f6cc19-9b02-4c6f-8b72-8d403b753163 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:31.840606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f6cc19-9b02-4c6f-8b72-8d403b753163 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:31.841083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f6cc19-9b02-4c6f-8b72-8d403b753163 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:31.841845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f6cc19-9b02-4c6f-8b72-8d403b753163 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:31.842274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f6cc19-9b02-4c6f-8b72-8d403b753163 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:31.870301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-87f6cc19-9b02-4c6f-8b72-8d403b753163 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039586 Jul 19 12:40:31.870770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 465/912] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:32.633948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=51 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:32.695657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=62 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:32.845313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:32.845960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:32.852886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:32.853339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:32.854098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:32.854564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:32.914406 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:32.921740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a2dc3821-2284-4739-bb41-d1ff31cc5254 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080217 Jul 19 12:40:32.922299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 466/913] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:32 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:32.926675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57a02874-fca9-47fc-a587-359c82fc1526 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:32.928148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57a02874-fca9-47fc-a587-359c82fc1526 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:32.933613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a02874-fca9-47fc-a587-359c82fc1526 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:32.934062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a02874-fca9-47fc-a587-359c82fc1526 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:32.934822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a02874-fca9-47fc-a587-359c82fc1526 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:32.935260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a02874-fca9-47fc-a587-359c82fc1526 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:32.951013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:32.964776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57a02874-fca9-47fc-a587-359c82fc1526 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041381 Jul 19 12:40:32.965347 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 467/914] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:33.938738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:33.939344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:33.945864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:33.946305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:33.947062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:33.947491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:34.008468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:34.015649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-63407c46-e7cb-443e-8a9e-5cd56599b151 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080717 Jul 19 12:40:34.016219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 468/915] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:33 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:34.021094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-990713d6-4180-4217-8e70-af676e3caf0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:34.021987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-990713d6-4180-4217-8e70-af676e3caf0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:34.027610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990713d6-4180-4217-8e70-af676e3caf0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:34.028063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990713d6-4180-4217-8e70-af676e3caf0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:34.028897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990713d6-4180-4217-8e70-af676e3caf0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:34.029365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990713d6-4180-4217-8e70-af676e3caf0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:34.057656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-990713d6-4180-4217-8e70-af676e3caf0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040471 Jul 19 12:40:34.058187 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 469/916] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:35.032494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:35.033140 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:35.040050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:35.040638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:35.041404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:35.041842 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:35.104468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:35.111796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-73e10b8f-52f9-475c-bec1-7a82ad9535cf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083083 Jul 19 12:40:35.112385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 470/917] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:35 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:35.116939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-547b6999-885a-4c52-93af-fe492ba84264 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:35.117874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-547b6999-885a-4c52-93af-fe492ba84264 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:35.123832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-547b6999-885a-4c52-93af-fe492ba84264 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:35.124326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-547b6999-885a-4c52-93af-fe492ba84264 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:35.125092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-547b6999-885a-4c52-93af-fe492ba84264 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:35.125551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-547b6999-885a-4c52-93af-fe492ba84264 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:35.154173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-547b6999-885a-4c52-93af-fe492ba84264 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 Jul 19 12:40:35.154713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 471/918] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:36.128531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:36.129089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:36.135963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:36.136452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:36.137205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:36.137637 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:36.198469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:36.205982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b09ddd2-04d7-42db-8180-2a5e2714cff0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081420 Jul 19 12:40:36.206542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 472/919] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:36 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:36.211108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-81d768d9-e816-4cf8-ad0b-75c67a97509c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:36.212008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-81d768d9-e816-4cf8-ad0b-75c67a97509c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:36.217514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d768d9-e816-4cf8-ad0b-75c67a97509c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:36.217963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d768d9-e816-4cf8-ad0b-75c67a97509c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:36.218722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d768d9-e816-4cf8-ad0b-75c67a97509c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:36.219155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d768d9-e816-4cf8-ad0b-75c67a97509c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:36.246794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-81d768d9-e816-4cf8-ad0b-75c67a97509c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039307 Jul 19 12:40:36.247327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 473/920] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:37.222246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:37.222927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:37.229993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:37.230441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:37.231192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:37.231621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:37.291355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:37.298665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c0c9ecb-c16c-46b9-8e25-47a68d8f6449 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080243 Jul 19 12:40:37.299217 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 474/921] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:37 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:37.303639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4404ed08-0fc4-4ad4-86da-7ca7af53ea24 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:37.304558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4404ed08-0fc4-4ad4-86da-7ca7af53ea24 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:37.310064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4404ed08-0fc4-4ad4-86da-7ca7af53ea24 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:37.310508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4404ed08-0fc4-4ad4-86da-7ca7af53ea24 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:37.311258 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4404ed08-0fc4-4ad4-86da-7ca7af53ea24 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:37.311689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4404ed08-0fc4-4ad4-86da-7ca7af53ea24 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:37.340294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4404ed08-0fc4-4ad4-86da-7ca7af53ea24 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040087 Jul 19 12:40:37.340838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 475/922] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:38.315252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:38.315882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:38.322299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:38.322746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:38.323502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:38.323932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:38.385760 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:38.393095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-069afd22-fcbf-414f-8a17-de0599aa459b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081688 Jul 19 12:40:38.393652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 476/923] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:38 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:38.398017 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0875f12-1034-4af5-bdcd-1d4c9b0dbd19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:38.398907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0875f12-1034-4af5-bdcd-1d4c9b0dbd19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:38.404601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0875f12-1034-4af5-bdcd-1d4c9b0dbd19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:38.405079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0875f12-1034-4af5-bdcd-1d4c9b0dbd19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:38.405893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0875f12-1034-4af5-bdcd-1d4c9b0dbd19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:38.406358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0875f12-1034-4af5-bdcd-1d4c9b0dbd19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:38.434871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0875f12-1034-4af5-bdcd-1d4c9b0dbd19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040269 Jul 19 12:40:38.435415 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 477/924] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:39.408717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:39.409324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:39.416373 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:39.416831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:39.417599 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:39.418038 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:39.488663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:39.496314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d277a18-6c36-4260-9d04-a24e6205f00c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.091440 Jul 19 12:40:39.496883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 478/925] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:39 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:39.501656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7e847bf1-8210-42b3-aecd-6128b4594712 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:39.502558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e847bf1-8210-42b3-aecd-6128b4594712 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:39.508145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e847bf1-8210-42b3-aecd-6128b4594712 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:39.508721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e847bf1-8210-42b3-aecd-6128b4594712 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:39.509478 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e847bf1-8210-42b3-aecd-6128b4594712 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:39.509909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e847bf1-8210-42b3-aecd-6128b4594712 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:39.538576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7e847bf1-8210-42b3-aecd-6128b4594712 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Jul 19 12:40:39.539111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 479/926] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:40.513031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:40.513674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:40.520093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:40.520575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:40.521343 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:40.521782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:40.582012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:40.589460 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2ead3a9f-0012-4eaf-8486-7b3dfba81e97 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080267 Jul 19 12:40:40.590029 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 480/927] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:40 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:40.594507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ffd9db37-b063-4c84-abde-5cdb36d364fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:40.595407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ffd9db37-b063-4c84-abde-5cdb36d364fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:40.601502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd9db37-b063-4c84-abde-5cdb36d364fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:40.601958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd9db37-b063-4c84-abde-5cdb36d364fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:40.602722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd9db37-b063-4c84-abde-5cdb36d364fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:40.603162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd9db37-b063-4c84-abde-5cdb36d364fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:40.632122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ffd9db37-b063-4c84-abde-5cdb36d364fa tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041086 Jul 19 12:40:40.632702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 481/928] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:41.605764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:41.606364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:41.612994 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:41.613446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:41.614702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:41.615133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:41.675011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:41.682886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ccf6f34c-c9af-4a44-a44b-73e8a0d22fb0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081072 Jul 19 12:40:41.683440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 482/929] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:41 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:41.687832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0ed2f64-ead4-444e-b88a-9c640e4c4a4b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:41.688753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0ed2f64-ead4-444e-b88a-9c640e4c4a4b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:41.694846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ed2f64-ead4-444e-b88a-9c640e4c4a4b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:41.695292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ed2f64-ead4-444e-b88a-9c640e4c4a4b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:41.696046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ed2f64-ead4-444e-b88a-9c640e4c4a4b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:41.696508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ed2f64-ead4-444e-b88a-9c640e4c4a4b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:41.724323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0ed2f64-ead4-444e-b88a-9c640e4c4a4b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039877 Jul 19 12:40:41.724867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 483/930] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:42.701685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:42.702530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:42.712608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:42.713319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:42.714473 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:42.715144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:42.721092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:42.787539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:42.794878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9e2ab184-df02-4b94-8d11-12ea3a86536d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.097743 Jul 19 12:40:42.795437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 484/931] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:42 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:42.799797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d97a78f1-07bf-41ae-b152-dc6397f2af09 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:42.800723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d97a78f1-07bf-41ae-b152-dc6397f2af09 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:42.806160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97a78f1-07bf-41ae-b152-dc6397f2af09 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:42.806609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97a78f1-07bf-41ae-b152-dc6397f2af09 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:42.807364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97a78f1-07bf-41ae-b152-dc6397f2af09 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:42.807796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97a78f1-07bf-41ae-b152-dc6397f2af09 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:42.836293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d97a78f1-07bf-41ae-b152-dc6397f2af09 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039846 Jul 19 12:40:42.836846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 485/932] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:43.811111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:43.811723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:43.819084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:43.819534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:43.820397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:43.820850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:43.884350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:43.891868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c52a8103-c89f-479f-9f0c-ce2772c19c3c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084574 Jul 19 12:40:43.892457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 486/933] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:43 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:43.896884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99eaa891-1f86-4e20-b2ae-69c3c826f706 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:43.897806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99eaa891-1f86-4e20-b2ae-69c3c826f706 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:43.903627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99eaa891-1f86-4e20-b2ae-69c3c826f706 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:43.904077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99eaa891-1f86-4e20-b2ae-69c3c826f706 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:43.904882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99eaa891-1f86-4e20-b2ae-69c3c826f706 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:43.905318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99eaa891-1f86-4e20-b2ae-69c3c826f706 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:43.933375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99eaa891-1f86-4e20-b2ae-69c3c826f706 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039969 Jul 19 12:40:43.933912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 487/934] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:44.908319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:44.908956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:44.915763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:44.916240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:44.917052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:44.917493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:44.977286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:44.984527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-359a23c7-d152-4af0-8a2a-1c1a29b02831 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080110 Jul 19 12:40:44.985081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 488/935] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:44 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:44.990239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8304ac41-095e-456e-aa41-fdbaf461d77c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:44.991139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8304ac41-095e-456e-aa41-fdbaf461d77c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:44.996737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8304ac41-095e-456e-aa41-fdbaf461d77c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:44.997186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8304ac41-095e-456e-aa41-fdbaf461d77c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:44.997945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8304ac41-095e-456e-aa41-fdbaf461d77c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:44.998631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8304ac41-095e-456e-aa41-fdbaf461d77c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:45.025673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8304ac41-095e-456e-aa41-fdbaf461d77c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039644 Jul 19 12:40:45.026210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 489/936] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:46.002722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:46.003332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:46.009852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:46.010304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:46.011064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:46.011502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:46.071672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:46.079008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5e2165f-7e72-4e49-8a47-45e08eed25f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081521 Jul 19 12:40:46.079569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 490/937] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:45 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:46.084088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-66142d33-fa6f-4ed4-a1ae-f4d1f80247ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:46.085012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-66142d33-fa6f-4ed4-a1ae-f4d1f80247ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:46.090560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66142d33-fa6f-4ed4-a1ae-f4d1f80247ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:46.091016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66142d33-fa6f-4ed4-a1ae-f4d1f80247ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:46.091777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66142d33-fa6f-4ed4-a1ae-f4d1f80247ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:46.092241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66142d33-fa6f-4ed4-a1ae-f4d1f80247ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:46.120115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-66142d33-fa6f-4ed4-a1ae-f4d1f80247ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039597 Jul 19 12:40:46.120684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 491/938] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:47.095207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:47.095814 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:47.102295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:47.102741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:47.103499 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:47.103931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:47.165341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:47.172746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf35830c-cf00-4f6b-b960-4f3e85779ad9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081335 Jul 19 12:40:47.173282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 492/939] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:47 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:47.177696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e11dd77-662e-4c47-b3f5-d7b76739817a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:47.178587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e11dd77-662e-4c47-b3f5-d7b76739817a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:47.184052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e11dd77-662e-4c47-b3f5-d7b76739817a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:47.184677 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e11dd77-662e-4c47-b3f5-d7b76739817a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:47.185294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e11dd77-662e-4c47-b3f5-d7b76739817a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:47.185735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e11dd77-662e-4c47-b3f5-d7b76739817a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:47.214158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e11dd77-662e-4c47-b3f5-d7b76739817a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039930 Jul 19 12:40:47.214698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 493/940] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:48.188622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:48.189231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:48.195882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:48.196364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:48.197119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:48.197550 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:48.260821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:48.268168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d7cac8c-0c5f-45b6-bc84-ac0a91f6a093 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083469 Jul 19 12:40:48.268746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 494/941] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:48 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:48.273595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a865cb50-26e8-4a33-a5bc-880422ee2893 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:48.274485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a865cb50-26e8-4a33-a5bc-880422ee2893 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:48.279897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a865cb50-26e8-4a33-a5bc-880422ee2893 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:48.280377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a865cb50-26e8-4a33-a5bc-880422ee2893 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:48.281135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a865cb50-26e8-4a33-a5bc-880422ee2893 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:48.281561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a865cb50-26e8-4a33-a5bc-880422ee2893 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:48.309978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a865cb50-26e8-4a33-a5bc-880422ee2893 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040272 Jul 19 12:40:48.310681 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 495/942] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:49.284197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:49.284860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:49.291822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:49.292299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:49.293061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:49.293495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:49.353384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:49.360784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e641b47a-14e4-4f1d-a9df-35be51b97280 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080452 Jul 19 12:40:49.361335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 496/943] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:49 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:49.365694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f55ec6a-d077-4733-aeea-69df539dda8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:49.366589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f55ec6a-d077-4733-aeea-69df539dda8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:49.372019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f55ec6a-d077-4733-aeea-69df539dda8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:49.372503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f55ec6a-d077-4733-aeea-69df539dda8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:49.373261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f55ec6a-d077-4733-aeea-69df539dda8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:49.373946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f55ec6a-d077-4733-aeea-69df539dda8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:49.402438 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f55ec6a-d077-4733-aeea-69df539dda8b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040137 Jul 19 12:40:49.402981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 497/944] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:50.377636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:50.378284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:50.384744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:50.385202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:50.385970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:50.386410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:50.446471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:50.453759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c3efa645-58e1-4d9d-8600-31c51aba35ff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080269 Jul 19 12:40:50.454320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 498/945] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:50 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:50.459344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-83eeafe0-e0b2-40d0-b7e6-ff6c01567b44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:50.460270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-83eeafe0-e0b2-40d0-b7e6-ff6c01567b44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:50.465799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83eeafe0-e0b2-40d0-b7e6-ff6c01567b44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:50.466257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83eeafe0-e0b2-40d0-b7e6-ff6c01567b44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:50.467026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83eeafe0-e0b2-40d0-b7e6-ff6c01567b44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:50.467468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83eeafe0-e0b2-40d0-b7e6-ff6c01567b44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:50.498835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-83eeafe0-e0b2-40d0-b7e6-ff6c01567b44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Jul 19 12:40:50.499411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 499/946] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:51.470699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:51.471362 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:51.474299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:51.479622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:51.480076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:51.480876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:51.481315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:51.543851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:51.547253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:51.552072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e74e2174-fb8d-4c9c-9b1a-ae056fd079e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085359 Jul 19 12:40:51.552668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 500/947] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:51 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:51.557320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f56715f1-a3e3-4990-bb8b-fe8c5b063b39 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:51.558214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f56715f1-a3e3-4990-bb8b-fe8c5b063b39 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:51.563903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f56715f1-a3e3-4990-bb8b-fe8c5b063b39 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:51.564687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f56715f1-a3e3-4990-bb8b-fe8c5b063b39 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:51.565444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f56715f1-a3e3-4990-bb8b-fe8c5b063b39 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:51.565876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f56715f1-a3e3-4990-bb8b-fe8c5b063b39 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:51.594970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f56715f1-a3e3-4990-bb8b-fe8c5b063b39 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Jul 19 12:40:51.595513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 501/948] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:52.568582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:52.569241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:52.575546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:52.575993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:52.576773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:52.577212 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:52.639854 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:52.648172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4eb84a9-9eb5-4687-9593-be45b3163ae0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083931 Jul 19 12:40:52.648756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 502/949] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:52 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:52.653144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7cde1d23-4d34-4cdb-9776-9dc3b53e9ce9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:52.654034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7cde1d23-4d34-4cdb-9776-9dc3b53e9ce9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:52.659466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cde1d23-4d34-4cdb-9776-9dc3b53e9ce9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:52.659912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cde1d23-4d34-4cdb-9776-9dc3b53e9ce9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:52.661192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cde1d23-4d34-4cdb-9776-9dc3b53e9ce9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:52.661625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cde1d23-4d34-4cdb-9776-9dc3b53e9ce9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:52.689903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7cde1d23-4d34-4cdb-9776-9dc3b53e9ce9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040183 Jul 19 12:40:52.690439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 503/950] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:53.664728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:53.665342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:53.671759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:53.672229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:53.672992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:53.673426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:53.733325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:53.741035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b7bbef54-251e-46ca-b7cd-8b3dafd126bf tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080128 Jul 19 12:40:53.741588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 504/951] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:53 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:53.745954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7254826d-355b-458f-91bb-36ad0b68ac14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:53.746843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7254826d-355b-458f-91bb-36ad0b68ac14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:53.752542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7254826d-355b-458f-91bb-36ad0b68ac14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:53.752990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7254826d-355b-458f-91bb-36ad0b68ac14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:53.753743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7254826d-355b-458f-91bb-36ad0b68ac14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:53.754829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7254826d-355b-458f-91bb-36ad0b68ac14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:53.782382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7254826d-355b-458f-91bb-36ad0b68ac14 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039830 Jul 19 12:40:53.782928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 505/952] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:54.758183 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:54.758800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:54.765330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:54.766200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:54.767101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:54.767543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:54.844731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:54.852128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-befc4699-ecc8-4a9f-b679-14c4beb30848 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.098328 Jul 19 12:40:54.852716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 506/953] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:54 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:54.857213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07adeb31-02c3-45cd-b7a6-0f2a42ebe18c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:54.858115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07adeb31-02c3-45cd-b7a6-0f2a42ebe18c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:54.863781 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adeb31-02c3-45cd-b7a6-0f2a42ebe18c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:54.864301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adeb31-02c3-45cd-b7a6-0f2a42ebe18c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:54.865008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adeb31-02c3-45cd-b7a6-0f2a42ebe18c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:54.865441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adeb31-02c3-45cd-b7a6-0f2a42ebe18c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:54.893923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07adeb31-02c3-45cd-b7a6-0f2a42ebe18c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040226 Jul 19 12:40:54.894471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 507/954] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:55.133789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:40:55.134373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:40:55.868619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:55.869226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:55.876264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:55.876716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:55.877472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:55.877906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:55.939671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:55.947126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94f0cd3f-7d71-4994-a1ba-ed4c0d170a53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082332 Jul 19 12:40:55.947699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 508/955] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:55 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:40:55.952248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38a85646-4d60-438e-a6c4-c5f5457c878a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:55.953181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38a85646-4d60-438e-a6c4-c5f5457c878a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:55.959265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a85646-4d60-438e-a6c4-c5f5457c878a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:55.959718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a85646-4d60-438e-a6c4-c5f5457c878a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:55.960520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a85646-4d60-438e-a6c4-c5f5457c878a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:55.960959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a85646-4d60-438e-a6c4-c5f5457c878a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:55.989026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38a85646-4d60-438e-a6c4-c5f5457c878a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040323 Jul 19 12:40:55.989567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 509/956] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:56.964242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:56.964887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:56.971185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:56.971633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:56.972489 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:56.972926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:57.037469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:57.044895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d42a975a-a893-4ddd-9368-f4993c7c5db4 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084553 Jul 19 12:40:57.045455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 510/957] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:56 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:57.049896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a396f3e-3668-4784-8ad3-02732d968cd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:57.052568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4a396f3e-3668-4784-8ad3-02732d968cd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:57.056516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a396f3e-3668-4784-8ad3-02732d968cd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:57.056971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a396f3e-3668-4784-8ad3-02732d968cd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:57.057736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a396f3e-3668-4784-8ad3-02732d968cd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:57.058173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a396f3e-3668-4784-8ad3-02732d968cd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:57.086684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a396f3e-3668-4784-8ad3-02732d968cd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040274 Jul 19 12:40:57.087230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 511/958] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:58.061563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:58.062239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:58.071019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:58.071466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:58.072254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:58.072691 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:58.134740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:58.142151 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-984457bb-2255-446b-ad6f-eb7dc1cac15d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084573 Jul 19 12:40:58.142645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 512/959] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:58 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:58.147063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6cbf6a5a-334a-45f0-a570-3d8cc9c91124 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:58.147979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6cbf6a5a-334a-45f0-a570-3d8cc9c91124 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:58.153494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbf6a5a-334a-45f0-a570-3d8cc9c91124 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:58.153939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbf6a5a-334a-45f0-a570-3d8cc9c91124 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:58.154694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbf6a5a-334a-45f0-a570-3d8cc9c91124 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:58.155125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbf6a5a-334a-45f0-a570-3d8cc9c91124 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:58.184266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6cbf6a5a-334a-45f0-a570-3d8cc9c91124 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040619 Jul 19 12:40:58.184827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 513/960] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:40:59.157976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:59.158640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:59.165600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:59.166040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:59.166794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:59.167222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:59.227127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:40:59.234382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-161b1f58-0840-4b6f-82fa-fb7d3292f18f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080261 Jul 19 12:40:59.234940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 514/961] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:40:59 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:40:59.239939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf2b9062-65e9-4504-870c-59390848007c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:40:59.240855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf2b9062-65e9-4504-870c-59390848007c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:40:59.246508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf2b9062-65e9-4504-870c-59390848007c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:59.246967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf2b9062-65e9-4504-870c-59390848007c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:59.247758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf2b9062-65e9-4504-870c-59390848007c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:40:59.248225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf2b9062-65e9-4504-870c-59390848007c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:40:59.276837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf2b9062-65e9-4504-870c-59390848007c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Jul 19 12:40:59.277396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 515/962] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:40:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:00.251028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:00.251675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:00.258864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:00.259316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:00.260079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:00.260543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:00.321846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:00.329076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a8374825-ca24-49b5-819a-80883bcf4c5b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082163 Jul 19 12:41:00.329637 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 516/963] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:00 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:00.334124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-120ceb0d-4f41-43f3-bb34-e33e1d53d7be tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:00.335027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-120ceb0d-4f41-43f3-bb34-e33e1d53d7be tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:00.340684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-120ceb0d-4f41-43f3-bb34-e33e1d53d7be tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:00.341133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-120ceb0d-4f41-43f3-bb34-e33e1d53d7be tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:00.341895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-120ceb0d-4f41-43f3-bb34-e33e1d53d7be tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:00.342332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-120ceb0d-4f41-43f3-bb34-e33e1d53d7be tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:00.358031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:00.371244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-120ceb0d-4f41-43f3-bb34-e33e1d53d7be tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040657 Jul 19 12:41:00.371788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 517/964] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:01.345523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:01.346166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:01.352153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:01.352632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:01.353410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:01.353877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:01.416678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:01.424283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eee60a62-1982-4c3c-9877-0791a64cf48c tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082705 Jul 19 12:41:01.424843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 518/965] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:01 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:01.429351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4d189bf-9556-4499-b54a-783e40f5d6fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:01.430251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4d189bf-9556-4499-b54a-783e40f5d6fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:01.436089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d189bf-9556-4499-b54a-783e40f5d6fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:01.436566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d189bf-9556-4499-b54a-783e40f5d6fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:01.437330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d189bf-9556-4499-b54a-783e40f5d6fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:01.437768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4d189bf-9556-4499-b54a-783e40f5d6fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:01.467197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4d189bf-9556-4499-b54a-783e40f5d6fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041367 Jul 19 12:41:01.467748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 519/966] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:02.440134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:02.440788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:02.447137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:02.447613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:02.448419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:02.448860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:02.510610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:02.517915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2db9ed66-153b-4204-b8e0-3b8111bc88cc tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082021 Jul 19 12:41:02.518464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 520/967] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:02 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:02.523324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-599d8838-f193-4d9c-88c3-4b2b2bb31002 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:02.524242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-599d8838-f193-4d9c-88c3-4b2b2bb31002 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:02.529860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599d8838-f193-4d9c-88c3-4b2b2bb31002 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:02.530323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599d8838-f193-4d9c-88c3-4b2b2bb31002 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:02.531125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599d8838-f193-4d9c-88c3-4b2b2bb31002 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:02.531568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599d8838-f193-4d9c-88c3-4b2b2bb31002 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:02.559961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-599d8838-f193-4d9c-88c3-4b2b2bb31002 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040544 Jul 19 12:41:02.560537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 521/968] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:03.075287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid cadeb57a-3504-4bac-86e9-e8ef951da265 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:41:03.535633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:03.536308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:03.542767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:03.543215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:03.543976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:03.544442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:03.604561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:03.612049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13afc18f-3727-43b9-9be2-c7fc65922b53 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080971 Jul 19 12:41:03.612630 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 522/969] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:03.617170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b5f9cc3-db64-44ca-b8dc-a028043c5062 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:03.618068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b5f9cc3-db64-44ca-b8dc-a028043c5062 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:03.623953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b5f9cc3-db64-44ca-b8dc-a028043c5062 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:03.624436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b5f9cc3-db64-44ca-b8dc-a028043c5062 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:03.625190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b5f9cc3-db64-44ca-b8dc-a028043c5062 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:03.625619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b5f9cc3-db64-44ca-b8dc-a028043c5062 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:03.653949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b5f9cc3-db64-44ca-b8dc-a028043c5062 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040362 Jul 19 12:41:03.654490 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 523/970] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:04.138702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:04.139131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:04.146886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:04.147329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:04.148090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:04.148548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:04.175568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:41:04.231926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [569d9e2b-a0ce-491d-a1db-15da5a43e6bc] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 12:41:05.239095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [569d9e2b-a0ce-491d-a1db-15da5a43e6bc] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59836. Jul 19 12:41:05.259388 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2dcb7ed-19a9-4f68-bdf3-40c1810e6856 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 204 len: 0 microversion: 2.1 time: 1.124455 Jul 19 12:41:05.259972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 524/971] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:41:04 2022] DELETE /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 12:41:05.266585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:05.267296 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:05.273740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:05.274197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:05.274970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:05.275410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:05.337449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:05.345227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4785add4-6d89-460a-99a0-f966e635583a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084130 Jul 19 12:41:05.345788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 525/972] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:05 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:41:05.350276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-88d8cf9a-183f-40c9-8873-f44eb2461b27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:05.351189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-88d8cf9a-183f-40c9-8873-f44eb2461b27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:05.356764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d8cf9a-183f-40c9-8873-f44eb2461b27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:05.357224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d8cf9a-183f-40c9-8873-f44eb2461b27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:05.357986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d8cf9a-183f-40c9-8873-f44eb2461b27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:05.358425 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d8cf9a-183f-40c9-8873-f44eb2461b27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:05.387232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-88d8cf9a-183f-40c9-8873-f44eb2461b27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040447 Jul 19 12:41:05.387783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 526/973] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:05.392201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:05.392810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:05.398926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:05.399383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:05.400140 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:05.400628 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:05.529899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:05.537951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7aafbdcd-d4c7-48d7-9dbf-7e69097c6d3a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1689 microversion: 2.1 time: 0.149189 Jul 19 12:41:05.538528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 527/974] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:05 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:41:06.361003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:06.361654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:06.368239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:06.368707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:06.369487 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:06.369932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:06.440206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:06.447736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-91a58667-e954-400c-bcf8-2130c2759735 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.090627 Jul 19 12:41:06.448369 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 528/975] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:41:06.452961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4660abd-b3bc-45ba-9919-858e34055ac4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:06.453870 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4660abd-b3bc-45ba-9919-858e34055ac4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:06.460197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4660abd-b3bc-45ba-9919-858e34055ac4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:06.460672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4660abd-b3bc-45ba-9919-858e34055ac4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:06.461437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4660abd-b3bc-45ba-9919-858e34055ac4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:06.461876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4660abd-b3bc-45ba-9919-858e34055ac4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:06.490751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4660abd-b3bc-45ba-9919-858e34055ac4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Jul 19 12:41:06.491314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 529/976] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:06.554848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:06.555462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:06.561705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:06.562057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:06.562822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:06.563264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:06.657652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:06.668232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7a5fe2ec-ff6f-4428-ba99-1ab69f1a343d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 200 len: 1621 microversion: 2.1 time: 0.117135 Jul 19 12:41:06.679060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 530/977] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:06 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 1621 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:06.797683 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-a76d719f-5cda-47e8-ac02-dd0705db11f5 req-05659005-7de7-494c-bd3b-da3a897ebca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b74d78c-d928-44cd-8bed-3105d5055fed", "name": "network-vif-deleted", "tag": "94eaf513-157f-4d2d-b4b9-db0f37900664"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:41:06.806858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-a76d719f-5cda-47e8-ac02-dd0705db11f5 req-05659005-7de7-494c-bd3b-da3a897ebca1 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:06.807586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-a76d719f-5cda-47e8-ac02-dd0705db11f5 req-05659005-7de7-494c-bd3b-da3a897ebca1 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:06.819692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-a76d719f-5cda-47e8-ac02-dd0705db11f5 req-05659005-7de7-494c-bd3b-da3a897ebca1 service nova] Creating event network-vif-deleted:94eaf513-157f-4d2d-b4b9-db0f37900664 for instance 6b74d78c-d928-44cd-8bed-3105d5055fed on hv-cinder-82099 Jul 19 12:41:06.825288 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-a76d719f-5cda-47e8-ac02-dd0705db11f5 req-05659005-7de7-494c-bd3b-da3a897ebca1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144884 Jul 19 12:41:06.826164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 531/978] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:07.465058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:07.465863 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:07.473452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:07.473990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:07.474857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:07.475368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:07.539421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:07.547035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7797b93e-6b3a-4c1f-89f0-1edce0c0fed8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.086650 Jul 19 12:41:07.547636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 532/979] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:07.556119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ea4a6d18-e6fc-4bea-b7f0-0b9afb1eb688 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:07.556119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ea4a6d18-e6fc-4bea-b7f0-0b9afb1eb688 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:07.559282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea4a6d18-e6fc-4bea-b7f0-0b9afb1eb688 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:07.559739 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea4a6d18-e6fc-4bea-b7f0-0b9afb1eb688 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:07.560544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea4a6d18-e6fc-4bea-b7f0-0b9afb1eb688 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:07.560987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea4a6d18-e6fc-4bea-b7f0-0b9afb1eb688 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:07.564930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:07.597506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ea4a6d18-e6fc-4bea-b7f0-0b9afb1eb688 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048564 Jul 19 12:41:07.598093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 533/980] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:07.685909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:07.686529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 6b74d78c-d928-44cd-8bed-3105d5055fed] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:07.693604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:07.694062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:07.694829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:07.695292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:07.710290 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] HTTP exception thrown: Instance 6b74d78c-d928-44cd-8bed-3105d5055fed could not be found. Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Request method failure captured: Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed HTTP/1.1 Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQOxsCk87izCeam6W8Y9KH8-hgnipPqGe_jLWuW7RWKjvkAqy-GskVE1KyYrSq8MmheGg4ODGWfp1Wp3HljkBwqH80TSvp7-jBt6wU1dIkqzIS9MdgICP6HPLe5J8XY1hpl-aNPxZFQzIKXwdGlFh1IpWvzSXgBi5-x0SdtFSMrmtM Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:41:07.711905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12a3207b8cea465d8d1ed5c9e3963a4f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 62766e7afd01401293df7e08707d6d95 Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance 6b74d78c-d928-44cd-8bed-3105d5055fed could not be found. Jul 19 12:41:07.713507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '6b74d78c-d928-44cd-8bed-3105d5055fed'} Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b74d78c-d928-44cd-8bed-3105d5055fed could not be found. Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:41:07.714410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b74d78c-d928-44cd-8bed-3105d5055fed could not be found. Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b74d78c-d928-44cd-8bed-3105d5055fed could not be found. Jul 19 12:41:07.715954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:41:07.717266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Returning 404 to user: Instance 6b74d78c-d928-44cd-8bed-3105d5055fed could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:41:07.717266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4648efe-64bb-4b8b-a3b6-0c00165bdc5a tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed" status: 404 len: 111 microversion: 2.1 time: 0.031372 Jul 19 12:41:07.717266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 534/981] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:07 2022] GET /compute/v2.1/servers/6b74d78c-d928-44cd-8bed-3105d5055fed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 12:41:07.721097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2af1b42f-5efc-4e70-85b2-4988481cb8bc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '.version_select at 0x7fd9941f6280>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:07.742869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2af1b42f-5efc-4e70-85b2-4988481cb8bc tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-790330851" status: 202 len: 0 microversion: 2.1 time: 0.025101 Jul 19 12:41:07.743422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 535/982] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jul 19 12:41:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-790330851 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 12:41:08.564134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:08.564790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:08.719235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:08.719686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:08.720502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:08.720944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:08.781242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:08.789057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2c8c9a60-189f-495f-9d1d-cdd9e035fa44 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.229362 Jul 19 12:41:08.789613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 536/983] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:08 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:08.794035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4e0ef5e-ab9a-4718-9fbf-d3e1db2613e7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:08.794969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4e0ef5e-ab9a-4718-9fbf-d3e1db2613e7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:08.801547 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4e0ef5e-ab9a-4718-9fbf-d3e1db2613e7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:08.802003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4e0ef5e-ab9a-4718-9fbf-d3e1db2613e7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:08.802795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4e0ef5e-ab9a-4718-9fbf-d3e1db2613e7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:08.803232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4e0ef5e-ab9a-4718-9fbf-d3e1db2613e7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:08.831096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4e0ef5e-ab9a-4718-9fbf-d3e1db2613e7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040462 Jul 19 12:41:08.831583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 537/984] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:09.806065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:09.806699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:09.813474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:09.813936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:09.814819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:09.815211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:09.882009 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:09.889504 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0f90f2cc-e943-4c1e-aaa5-f77d39a8a64b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.087374 Jul 19 12:41:09.890071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 538/985] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:09 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:09.894649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2e19b7b8-6b33-4b14-8004-3e53a8ef650a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:09.895553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2e19b7b8-6b33-4b14-8004-3e53a8ef650a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:09.901584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e19b7b8-6b33-4b14-8004-3e53a8ef650a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:09.902036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e19b7b8-6b33-4b14-8004-3e53a8ef650a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:09.902809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e19b7b8-6b33-4b14-8004-3e53a8ef650a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:09.903234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e19b7b8-6b33-4b14-8004-3e53a8ef650a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:09.933138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2e19b7b8-6b33-4b14-8004-3e53a8ef650a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042100 Jul 19 12:41:09.933678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 539/986] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:10.906045 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:10.906690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:10.913648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:10.914107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:10.914887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:10.915381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:10.975084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:10.982383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-96b7af18-fa12-4396-b2b0-274ebf31e4b9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080248 Jul 19 12:41:10.982935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 540/987] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:10 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:10.987293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-34ceb1ff-e7a3-4a51-900f-a086761b083b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:10.988287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-34ceb1ff-e7a3-4a51-900f-a086761b083b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:10.993667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ceb1ff-e7a3-4a51-900f-a086761b083b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:10.994115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ceb1ff-e7a3-4a51-900f-a086761b083b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:10.994869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ceb1ff-e7a3-4a51-900f-a086761b083b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:10.995390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ceb1ff-e7a3-4a51-900f-a086761b083b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:11.025705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-34ceb1ff-e7a3-4a51-900f-a086761b083b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Jul 19 12:41:11.026245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 541/988] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:11.999178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:11.999790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:12.006801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:12.007257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:12.008023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:12.008482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:12.067265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:12.074526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0577c4b9-5d2d-4619-9649-3a169e9d7443 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079465 Jul 19 12:41:12.075077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 542/989] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:11 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:12.079446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-39f7cbbf-76e0-414a-a4d3-fa44e96ceff5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:12.080376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-39f7cbbf-76e0-414a-a4d3-fa44e96ceff5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:12.086530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39f7cbbf-76e0-414a-a4d3-fa44e96ceff5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:12.086985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39f7cbbf-76e0-414a-a4d3-fa44e96ceff5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:12.087749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39f7cbbf-76e0-414a-a4d3-fa44e96ceff5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:12.088200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39f7cbbf-76e0-414a-a4d3-fa44e96ceff5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:12.115660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-39f7cbbf-76e0-414a-a4d3-fa44e96ceff5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039616 Jul 19 12:41:12.116213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 543/990] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:13.091168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:13.091813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:13.098716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:13.099201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:13.099958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:13.100437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:13.111768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:13.162483 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:13.169993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-251c7fa0-1e15-4ee1-91f3-6bbbc9e47907 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082631 Jul 19 12:41:13.170544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 544/991] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:13.174977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-878a13ca-69fb-4ef9-a637-904d937e1a72 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:13.176395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-878a13ca-69fb-4ef9-a637-904d937e1a72 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:13.182069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878a13ca-69fb-4ef9-a637-904d937e1a72 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:13.182530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878a13ca-69fb-4ef9-a637-904d937e1a72 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:13.183300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878a13ca-69fb-4ef9-a637-904d937e1a72 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:13.183767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878a13ca-69fb-4ef9-a637-904d937e1a72 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:13.212204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-878a13ca-69fb-4ef9-a637-904d937e1a72 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 Jul 19 12:41:13.212749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 545/992] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:14.187084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:14.187767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:14.190027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:14.195368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:14.195820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:14.196612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:14.197049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:14.223798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:41:14.228170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 (ip 10.222.0.13) !!! Jul 19 12:41:14.262511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:14.270065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-334b78fd-bc4f-4890-8d94-30cfa1d4096f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.086886 Jul 19 12:41:14.270946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 546/993] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:14.275263 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-27ad3515-6f36-41e0-9457-79800c4f7606 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:14.276171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-27ad3515-6f36-41e0-9457-79800c4f7606 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:14.283259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27ad3515-6f36-41e0-9457-79800c4f7606 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:14.283709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27ad3515-6f36-41e0-9457-79800c4f7606 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:14.285002 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27ad3515-6f36-41e0-9457-79800c4f7606 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:14.285439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27ad3515-6f36-41e0-9457-79800c4f7606 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:14.313728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-27ad3515-6f36-41e0-9457-79800c4f7606 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042007 Jul 19 12:41:14.314270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 547/994] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:15.286593 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:15.287259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:15.293668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:15.294124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:15.294895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:15.295335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:15.358639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:15.366753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eac7e04e-065f-41c8-8ec0-0369d4330bc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084032 Jul 19 12:41:15.367311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 548/995] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:15 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:15.371733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0068b9f1-4a4d-4265-adb3-a1ba0cfbbe9d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:15.372660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0068b9f1-4a4d-4265-adb3-a1ba0cfbbe9d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:15.379090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0068b9f1-4a4d-4265-adb3-a1ba0cfbbe9d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:15.379538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0068b9f1-4a4d-4265-adb3-a1ba0cfbbe9d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:15.380335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0068b9f1-4a4d-4265-adb3-a1ba0cfbbe9d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:15.380770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0068b9f1-4a4d-4265-adb3-a1ba0cfbbe9d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:15.407945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0068b9f1-4a4d-4265-adb3-a1ba0cfbbe9d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039675 Jul 19 12:41:15.408512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 549/996] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:16.306286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:41:16.306956 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:41:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:41:16.382816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:16.383425 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:16.389960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:16.390423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:16.391194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:16.391631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:16.454000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:16.461431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b1084d4-502b-47cf-8fce-1622e9df7f76 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082492 Jul 19 12:41:16.461995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 550/997] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:16 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:16.466416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0d0b2904-8cae-4d41-9fb0-485ee9b5a6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:16.467314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0d0b2904-8cae-4d41-9fb0-485ee9b5a6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:16.473322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d0b2904-8cae-4d41-9fb0-485ee9b5a6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:16.473779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d0b2904-8cae-4d41-9fb0-485ee9b5a6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:16.474537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d0b2904-8cae-4d41-9fb0-485ee9b5a6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:16.474973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d0b2904-8cae-4d41-9fb0-485ee9b5a6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:16.491558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:16.504571 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0d0b2904-8cae-4d41-9fb0-485ee9b5a6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041594 Jul 19 12:41:16.505113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 551/998] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:17.477855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:17.478541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:17.484946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:17.485398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:17.486159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:17.486597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:17.550727 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:17.558151 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eea1264f-faa7-4405-909f-816eecf58a11 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084174 Jul 19 12:41:17.558710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 552/999] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:17.563190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf0db80e-de90-41a4-ad26-ccb0ddb5ad4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:17.564116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf0db80e-de90-41a4-ad26-ccb0ddb5ad4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:17.570545 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0db80e-de90-41a4-ad26-ccb0ddb5ad4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:17.570996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0db80e-de90-41a4-ad26-ccb0ddb5ad4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:17.571760 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0db80e-de90-41a4-ad26-ccb0ddb5ad4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:17.572215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0db80e-de90-41a4-ad26-ccb0ddb5ad4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:17.599635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf0db80e-de90-41a4-ad26-ccb0ddb5ad4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039976 Jul 19 12:41:17.600198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 553/1000] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:18.576305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:18.576899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:18.583889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:18.584382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:18.585152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:18.585594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:18.646361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:18.653728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4a5e80e-335f-475c-b8d8-7a999ddc65b8 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081427 Jul 19 12:41:18.654291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 554/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:18.658713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db84476a-d70a-4401-ab72-14d2efee1765 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:18.659616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db84476a-d70a-4401-ab72-14d2efee1765 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:18.665158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db84476a-d70a-4401-ab72-14d2efee1765 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:18.665622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db84476a-d70a-4401-ab72-14d2efee1765 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:18.666384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db84476a-d70a-4401-ab72-14d2efee1765 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:18.666856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db84476a-d70a-4401-ab72-14d2efee1765 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:18.694759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db84476a-d70a-4401-ab72-14d2efee1765 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039503 Jul 19 12:41:18.695308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 555/1002] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:19.670049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:19.670736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:19.678055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:19.678315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:19.679078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:19.679511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:19.739552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:19.746968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-546b24fd-914c-43f1-bf21-410d728857be tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080817 Jul 19 12:41:19.747519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 556/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:19.752245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-004c513e-e25d-4e80-89f4-92337a0f929d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:19.753706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-004c513e-e25d-4e80-89f4-92337a0f929d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:19.760442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-004c513e-e25d-4e80-89f4-92337a0f929d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:19.761003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-004c513e-e25d-4e80-89f4-92337a0f929d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:19.761792 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-004c513e-e25d-4e80-89f4-92337a0f929d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:19.762231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-004c513e-e25d-4e80-89f4-92337a0f929d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:19.793520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-004c513e-e25d-4e80-89f4-92337a0f929d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Jul 19 12:41:19.794123 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 557/1004] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:41:20.804821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8a73914-4ee8-4264-be91-059f80e29a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:20.805746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8a73914-4ee8-4264-be91-059f80e29a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:20.812286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8a73914-4ee8-4264-be91-059f80e29a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:20.812743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8a73914-4ee8-4264-be91-059f80e29a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:20.813588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8a73914-4ee8-4264-be91-059f80e29a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:20.814034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8a73914-4ee8-4264-be91-059f80e29a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:20.842930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8a73914-4ee8-4264-be91-059f80e29a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 Jul 19 12:41:20.843475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 558/1005] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:41:20.848388 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:20.848987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:20.854385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:20.854873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:20.855756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:20.856304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:20.916831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:20.924142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94f670e5-d7f5-4580-b6d3-bc7d035216f5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079695 Jul 19 12:41:20.924732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 559/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:20 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:41:21.854313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b94dac74-ae1e-4b9f-9466-5238fa304244 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:21.855233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b94dac74-ae1e-4b9f-9466-5238fa304244 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:21.861793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b94dac74-ae1e-4b9f-9466-5238fa304244 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:21.862242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b94dac74-ae1e-4b9f-9466-5238fa304244 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:21.863629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b94dac74-ae1e-4b9f-9466-5238fa304244 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:21.864065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b94dac74-ae1e-4b9f-9466-5238fa304244 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:21.891904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b94dac74-ae1e-4b9f-9466-5238fa304244 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Jul 19 12:41:21.892418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 560/1007] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:41:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:41:21.940759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:21.941400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:21.947149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:21.947600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:21.948392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:21.948832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:22.010871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:41:22.018212 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4c8221f-cef6-4721-b14d-cf9c03a02ff6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081035 Jul 19 12:41:22.019318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 561/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:41:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:41:22.645185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:41:22.645686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:41:22.651737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:22.652212 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:22.652982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:41:22.653421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:41:32.648923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=33 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:32.671435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=66 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:55.264343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:41:55.264924 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:42:22.833816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-85b99188-9a7e-448b-8a6a-33a585727354 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909" status: 202 len: 0 microversion: 2.1 time: 120.208512 Jul 19 12:42:22.835063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 448/1009] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:40:22 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 => generated 0 bytes in 120211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 12:42:22.841160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8d5dcc91-eb5f-433f-8c04-d122753a7a1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:42:22.842471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8d5dcc91-eb5f-433f-8c04-d122753a7a1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:42:22.849793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8d5dcc91-eb5f-433f-8c04-d122753a7a1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:42:22.850255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8d5dcc91-eb5f-433f-8c04-d122753a7a1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:42:22.851031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8d5dcc91-eb5f-433f-8c04-d122753a7a1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:42:22.851469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8d5dcc91-eb5f-433f-8c04-d122753a7a1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:42:22.883254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8d5dcc91-eb5f-433f-8c04-d122753a7a1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Jul 19 12:42:22.883884 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 449/1010] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 12:42:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:42:22.888467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:42:22.889097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:42:22.896425 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:42:22.896883 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:42:22.897652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:42:22.898097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:42:22.962102 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:42:22.969686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d0431893-83dd-4afe-a19c-374ecff185d5 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084826 Jul 19 12:42:22.970259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 450/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:42:22 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:42:22.974949 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:42:22.975435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:42:22.981869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:42:22.982507 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:42:22.983071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:42:22.983905 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:42:23.046182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid cadeb57a-3504-4bac-86e9-e8ef951da265 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:42:32.981087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:33.008998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:33.050840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:03.182288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid cadeb57a-3504-4bac-86e9-e8ef951da265 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:43:03.210423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Request method failure captured: Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 HTTP/1.1 Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRwhCWuxwtHqwEaWtIpriGmsmHCGOtoB3kM1ahNyEIPaY7p7NIZkU5evHjcQ8k3Q8zGT8qYqoPLvIBbWOSvyYEoeWFvbswBeyLwlaUpKaN3BmI01RVK8t24CrN8FTpn8uOceTpuVxBtXjoQ1f5AtEPiSZDMdfCyRrYN9HGrsigEkL0 Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:43:03.212515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f6b44bed4904d50b5f1ebfc5ab34743", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 70c035662359493e86c58a3d40150eb8 Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:43:03.214156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'cadeb57a-3504-4bac-86e9-e8ef951da265', 'id': '857fe256-77d1-451e-8353-deaa74981909'} Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:43:03.215522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:43:03.217256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:43:03.220543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:43:03.222979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) Jul 19 12:43:03.225455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:43:03.227624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09cb8c16-de10-418b-80e1-f285131a5382) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:43:03.227624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41cf8d3f-0e32-49c9-b84f-a5821a7050f4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909" status: 400 len: 269 microversion: 2.1 time: 100.572893 Jul 19 12:43:03.227624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 562/1012] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:41:22 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 => generated 269 bytes in 100574 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 12:43:03.227624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:03.227981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:03.228606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:03.229053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:03.229821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:03.230279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:03.254668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:43:03.302687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.compute.api [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Instance is already in deleting state, ignoring this request Jul 19 12:43:03.303538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2cf0f915-5716-46ac-a5f8-fc8ac4c25b63 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 204 len: 0 microversion: 2.1 time: 0.087910 Jul 19 12:43:03.304208 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 563/1013] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:43:03 2022] DELETE /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:43:03.385543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1657d0f5-442d-4437-944c-c95aeb6706cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:43:03.386537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1657d0f5-442d-4437-944c-c95aeb6706cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:03.392850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657d0f5-442d-4437-944c-c95aeb6706cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:03.393329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657d0f5-442d-4437-944c-c95aeb6706cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:03.394099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657d0f5-442d-4437-944c-c95aeb6706cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:03.394537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657d0f5-442d-4437-944c-c95aeb6706cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:03.469564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1657d0f5-442d-4437-944c-c95aeb6706cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/action" status: 200 len: 41136 microversion: 2.1 time: 0.164225 Jul 19 12:43:03.470184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 564/1014] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 12:43:03 2022] POST /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3/action => generated 41136 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:43:03.475073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:03.475761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:03.482723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:03.483170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:03.483927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:03.484887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:03.546027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:03.553979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad13e7e0-f160-4fa0-8431-222d5887dbc1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082720 Jul 19 12:43:03.554534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 565/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:43:04.571171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:04.571833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:04.578215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:04.578687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:04.579439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:04.579875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:04.640283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:04.647832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-649f917b-195b-4ffb-a28a-b1ee7ad1edf9 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080536 Jul 19 12:43:04.648436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 566/1016] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:04 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:05.664870 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:05.665514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:05.672598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:05.673053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:05.673813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:05.674253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:05.736784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:05.744166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-162869a4-b0ce-4606-b4b8-fd02750694a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083144 Jul 19 12:43:05.744747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 567/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:05 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:06.761573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:06.762192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:06.768658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:06.769104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:06.769858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:06.770286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:06.829829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:06.837087 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f71f7dc-71ea-48cc-ad03-44824956dcf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079327 Jul 19 12:43:06.837639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 568/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:07.854383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:07.855007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:07.861926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:07.862371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:07.863127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:07.863560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:07.925234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:07.932729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2484070-340a-4fe9-836b-93c570efdfff tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082249 Jul 19 12:43:07.933291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 569/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:08.949239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:08.949850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:08.956706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:08.957154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:08.957909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:08.958342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:09.018234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:09.025596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7098eb5e-768b-4984-9e40-83da9fa6fea7 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080287 Jul 19 12:43:09.026156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 570/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:08 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:10.042757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:10.043364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:10.050255 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:10.050699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:10.051454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:10.051884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:10.116106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:10.123493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e0395ec-d3a2-413e-a261-6a5f3c099364 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084594 Jul 19 12:43:10.124051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 571/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:10 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:11.141296 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:11.141971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:11.148488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:11.148952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:11.149716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:11.150166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:11.210204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:11.217621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38376fab-74d6-4e33-8ca1-862f0248e837 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080867 Jul 19 12:43:11.218190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 572/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:11 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:12.296959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:12.297590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:12.303405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:12.303853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:12.304633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:12.305069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:12.365207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:12.372612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24c63c2b-c3d4-485f-b09d-c5ce767ba33a tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.142694 Jul 19 12:43:12.373162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 573/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:12 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:13.186920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:13.389332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:13.389948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:13.396393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:13.396840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:13.397603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:13.398036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:13.459841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:13.467724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b665d293-f8fa-4403-aa87-09b1223fbd28 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082248 Jul 19 12:43:13.468336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 574/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:14.485565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:14.486233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:14.492562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:14.493015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:14.493775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:14.494205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:14.559540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:14.566979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52a30277-742b-415f-a1dc-9b0e79c738ec tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085897 Jul 19 12:43:14.567544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 575/1025] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:15.584026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:15.584831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:15.591104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:15.591554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:15.592354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:15.592789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:15.655164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:15.663295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6dbe236d-e0e5-4b57-9b62-ac5487255cea tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083756 Jul 19 12:43:15.663851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 576/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:15 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:16.680540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:16.681167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:16.688116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:16.688596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:16.689368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:16.689810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:16.757483 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:16.764957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c74ff56-d0be-466f-9e67-813bddc5c3df tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088399 Jul 19 12:43:16.765530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 577/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:16 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:17.782284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:17.782886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:17.789274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:17.789720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:17.790475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:17.790910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:17.808018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:17.852307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:17.859669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-147f866f-fa17-48dd-86e2-e73ab934aece tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081852 Jul 19 12:43:17.860256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 578/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:18.876357 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:18.876971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:18.883809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:18.884281 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:18.885159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:18.885597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:18.948508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:18.955929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8759639-443c-46c1-b175-9baf07881cad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083540 Jul 19 12:43:18.956525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 579/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:19.972525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:19.973143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:19.979533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:19.979982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:19.980846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:19.981283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:20.042679 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:20.050750 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b50ec91-d49c-455e-ba23-283d38a11b0d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082100 Jul 19 12:43:20.051313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 580/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:21.067703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:21.068446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:21.074782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:21.075238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:21.076003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:21.076470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:21.135979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:21.143947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-076d59ea-a2ee-48e8-bf9b-e5c9590bb8ad tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080105 Jul 19 12:43:21.144543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 581/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:22.161433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:22.162054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:22.168655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:22.169112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:22.169886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:22.170341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:22.233531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:43:22.240821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-58c9a9d3-2645-4964-a98b-3b427ba82968 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083306 Jul 19 12:43:22.241381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 582/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:43:22 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:43:22.822935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:43:22.823442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:43:22.829441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:22.829894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:22.830661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:43:22.831101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:43:28.341235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:43:28.341885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:43:32.826723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=42 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:32.849293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=30 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:15.144364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:44:15.144944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:44:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:44:23.252310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Request method failure captured: Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 HTTP/1.1 Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRwhCWuxwtHqwEaWtIpriGmsmHCGOtoB3kM1ahNyEIPaY7p7NIZkU5evHjcQ8k3Q8zGT8qYqoPLvIBbWOSvyYEoeWFvbswBeyLwlaUpKaN3BmI01RVK8t24CrN8FTpn8uOceTpuVxBtXjoQ1f5AtEPiSZDMdfCyRrYN9HGrsigEkL0 Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:44:23.255413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f6b44bed4904d50b5f1ebfc5ab34743", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 70c035662359493e86c58a3d40150eb8 Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:44:23.256803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'server_id': 'cadeb57a-3504-4bac-86e9-e8ef951da265', 'id': '857fe256-77d1-451e-8353-deaa74981909'} Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:44:23.258030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:44:23.259434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:44:23.261124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:44:23.262567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) Jul 19 12:44:23.264166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:44:23.265671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b7c4e579-5a04-4d58-863a-d33f14071d84) {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:44:23.265671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-df5e8162-051e-42b9-96d7-d4aa17e8b278 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909" status: 400 len: 269 microversion: 2.1 time: 120.285643 Jul 19 12:44:23.265671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 451/1033] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:42:22 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 => generated 269 bytes in 120287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 12:44:23.265671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:44:23.266026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:44:23.272995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:44:23.273447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:44:23.274205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:44:23.274635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:44:23.339991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:44:23.347442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-64abbea9-b1ee-4d8c-b123-7feb5962a39b tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.088607 Jul 19 12:44:23.348012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 452/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:44:23 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:44:23.352543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:44:23.353028 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:44:23.358666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:44:23.359115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:44:23.359876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:44:23.360344 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:44:23.555519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid cadeb57a-3504-4bac-86e9-e8ef951da265 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:44:33.358197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:33.378410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=10 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:33.560257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:34.236485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:44:34.236724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:44:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:44:36.315770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:44:36.316324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:44:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:45:03.461285 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid cadeb57a-3504-4bac-86e9-e8ef951da265 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:45:03.489154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Request method failure captured: Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 HTTP/1.1 Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRwhCWuxwtHqwEaWtIpriGmsmHCGOtoB3kM1ahNyEIPaY7p7NIZkU5evHjcQ8k3Q8zGT8qYqoPLvIBbWOSvyYEoeWFvbswBeyLwlaUpKaN3BmI01RVK8t24CrN8FTpn8uOceTpuVxBtXjoQ1f5AtEPiSZDMdfCyRrYN9HGrsigEkL0 Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:45:03.491404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f6b44bed4904d50b5f1ebfc5ab34743", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 70c035662359493e86c58a3d40150eb8 Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:45:03.493048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'cadeb57a-3504-4bac-86e9-e8ef951da265', 'id': '857fe256-77d1-451e-8353-deaa74981909'} Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:45:03.493912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:45:03.494993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:45:03.496148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:45:03.497186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) Jul 19 12:45:03.498312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:45:03.499396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ce93366-587c-4bed-9718-c680535ff60a) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:45:03.499396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-31e58a30-38c5-4447-95d1-4b46e967e58e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909" status: 400 len: 269 microversion: 2.1 time: 100.737040 Jul 19 12:45:03.499396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 583/1035] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:43:22 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 => generated 269 bytes in 100738 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 12:45:03.500948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:03.501497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:03.507832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:03.508314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:03.509085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:03.509530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:03.572712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:03.580050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d97c0d65-ab7f-4b06-a9ba-ca9dc0e197e6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085424 Jul 19 12:45:03.581270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 584/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:03 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:45:04.597355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:04.598057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:04.604400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:04.604861 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:04.605635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:04.606073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:04.667543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:04.675598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9af23b0a-f923-4e48-a226-1dc5e15ef64f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.082597 Jul 19 12:45:04.676162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 585/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:04 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:05.692393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:05.693006 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:05.699492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:05.699948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:05.700747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:05.701189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:05.764120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:05.771541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-73625c3d-9332-4cb3-a747-91ce1c84bd85 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083625 Jul 19 12:45:05.772101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 586/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:05 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:06.787940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:06.788616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:06.794944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:06.795399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:06.796163 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:06.796627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:06.855927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:06.863274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07a57486-8e45-4644-b59c-d365f79fce10 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079190 Jul 19 12:45:06.863838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 587/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:06 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:07.879765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:07.880368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:07.887110 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:07.887564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:07.888363 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:07.888800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:07.949116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:07.957054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5e88b265-ac14-472d-b2a9-100a51c13187 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081228 Jul 19 12:45:07.957621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 588/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:07 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:08.974276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:08.974900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:08.981275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:08.981732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:08.982498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:08.982937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:09.042920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:09.050953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a64220f-d015-4a72-818e-ce8792f16ab0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.081132 Jul 19 12:45:09.051513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 589/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:08 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:10.067454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:10.068072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:10.074554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:10.075011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:10.075782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:10.076251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:10.141302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:10.148726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc1ee6f9-f2e2-4f06-aea0-7fc3e72e7478 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085760 Jul 19 12:45:10.149289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 590/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:10 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:11.164973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:11.165655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:11.171991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:11.172477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:11.173244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:11.173811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:11.232936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:11.240326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9f3b4615-72c0-4b38-9e5a-b82abd1b4172 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.079211 Jul 19 12:45:11.240890 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 591/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:11 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:12.257412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:12.258099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:12.264509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:12.264955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:12.265711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:12.266141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:12.325831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:12.333257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f6e111a-eac9-42e1-8110-4962baf7b3e3 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080526 Jul 19 12:45:12.333812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 592/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:12 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:13.349995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:13.350666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:13.357139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:13.357592 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:13.358358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:13.358795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:13.418603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:13.425998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f16b7539-481d-4379-b16c-1f5821104210 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080038 Jul 19 12:45:13.426552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 593/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:13 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:13.465629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:45:14.442003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:14.442572 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:14.448985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:14.449462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:14.450216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:14.450658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:14.515514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:14.523496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-736c6b71-23de-4f6f-af93-251906e12f71 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.085419 Jul 19 12:45:14.524064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 594/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:14 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:15.271741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:45:15.272338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:45:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 (ip 10.222.0.13) !!! Jul 19 12:45:15.540153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:15.540730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:15.547127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:15.547586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:15.548377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:15.548819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:15.611685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:15.619991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb497b30-4a65-4db2-8cf1-c55d9880ddf0 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083706 Jul 19 12:45:15.620726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 595/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:15 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:16.641349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:16.642006 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:16.649936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:16.650388 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:16.651364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:16.651797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:16.714157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:16.721443 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af81bd38-1447-4bc9-90cc-d76789919860 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.086357 Jul 19 12:45:16.721997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 596/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:16 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:17.737748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:17.738387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:17.745160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:17.745646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:17.746411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:17.746846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:17.810729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:17.818582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43bff3bb-f6d1-446d-a1aa-22c91991188f tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.084674 Jul 19 12:45:17.819145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 597/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:17 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:18.834798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:18.835444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:18.841837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:18.842288 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:18.843057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:18.843496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:18.914925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:18.922435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0d1f5667-48d6-492c-aecd-3a27f470e1a6 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.091487 Jul 19 12:45:18.923008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 598/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:18 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:19.938833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:19.939506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:19.946456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:19.946926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:19.947662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:19.948093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:20.008208 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:20.015670 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf186765-d7bf-44ff-ac8b-efe6dc995fd1 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080746 Jul 19 12:45:20.016255 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 599/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:19 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:21.032474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:21.033138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:21.039446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:21.039895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:21.040683 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:21.041119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:21.058737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:45:21.101914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:21.109287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0254a76b-8290-4e67-a146-451b5f308a50 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.080704 Jul 19 12:45:21.109839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 600/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:21 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:22.126257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:22.126911 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:22.134129 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:22.134587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:22.135366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:22.135806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:22.198157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:45:22.205697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-72063390-3bc8-410f-88a2-92cce9edcb6d tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1224 microversion: 2.1 time: 0.083304 Jul 19 12:45:22.206268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 601/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:45:22 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:45:22.876839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:45:22.877298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:45:22.883632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:22.884080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:22.884873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:45:22.885309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:45:32.880882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=38 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:45:32.903725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=12 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:46:23.758283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Request method failure captured: Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 HTTP/1.1 Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRwhCWuxwtHqwEaWtIpriGmsmHCGOtoB3kM1ahNyEIPaY7p7NIZkU5evHjcQ8k3Q8zGT8qYqoPLvIBbWOSvyYEoeWFvbswBeyLwlaUpKaN3BmI01RVK8t24CrN8FTpn8uOceTpuVxBtXjoQ1f5AtEPiSZDMdfCyRrYN9HGrsigEkL0 Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:46:23.761701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f6b44bed4904d50b5f1ebfc5ab34743", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 70c035662359493e86c58a3d40150eb8 Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:46:23.763155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'server_id': 'cadeb57a-3504-4bac-86e9-e8ef951da265', 'id': '857fe256-77d1-451e-8353-deaa74981909'} Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:46:23.763797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:46:23.765108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:23.767188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:23.769754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) Jul 19 12:46:23.771307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:23.772657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328b1449-1074-4869-a653-369def9dadda) {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:46:23.772657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0390b3ed-5ff9-4860-9058-e4fbb0fa1727 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909" status: 400 len: 269 microversion: 2.1 time: 120.414308 Jul 19 12:46:23.772657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 453/1054] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:44:23 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 => generated 269 bytes in 120415 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 12:46:23.772657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:46:23.773028 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:46:23.777469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:46:23.777926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:46:23.778731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:46:23.779170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:46:23.812777 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:46:23.813129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:46:23.813584 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lazy-loading 'fault' on Instance uuid c1b6e8ae-5267-4927-8b70-b808809b7963 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:46:23.857847 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880c0417a58d48ceaab3912957f2e4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a603ce9a934f188a137ee171d66aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:46:23.865580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d34d6e6f-a150-40da-9507-e333857ef001 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 200 len: 1229 microversion: 2.1 time: 0.100680 Jul 19 12:46:23.866074 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 454/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:46:23 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:46:23.870614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:46:23.871107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:46:23.876706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:46:23.877167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:46:23.877939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:46:23.878382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:46:24.113345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid cadeb57a-3504-4bac-86e9-e8ef951da265 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:46:24.306437 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid cadeb57a-3504-4bac-86e9-e8ef951da265 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:46:24.334142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Request method failure captured: Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 HTTP/1.1 Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRwhCWuxwtHqwEaWtIpriGmsmHCGOtoB3kM1ahNyEIPaY7p7NIZkU5evHjcQ8k3Q8zGT8qYqoPLvIBbWOSvyYEoeWFvbswBeyLwlaUpKaN3BmI01RVK8t24CrN8FTpn8uOceTpuVxBtXjoQ1f5AtEPiSZDMdfCyRrYN9HGrsigEkL0 Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:46:24.336321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f6b44bed4904d50b5f1ebfc5ab34743", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 70c035662359493e86c58a3d40150eb8 Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:46:24.337612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'cadeb57a-3504-4bac-86e9-e8ef951da265', 'id': '857fe256-77d1-451e-8353-deaa74981909'} Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:46:24.338427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:46:24.339468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.340603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:24.341594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) Jul 19 12:46:24.342687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.343732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bee411e5-5e7a-4e56-8abe-b579f8e9e776) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:46:24.343732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bd1b6e5c-eae7-4afe-aa76-3783035a9134 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909" status: 400 len: 269 microversion: 2.1 time: 61.465148 Jul 19 12:46:24.343732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 602/1056] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:45:22 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 => generated 269 bytes in 61466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 12:46:24.345502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:46:24.346115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] [instance: c1b6e8ae-5267-4927-8b70-b808809b7963] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:46:24.352380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:46:24.352843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:46:24.353618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:46:24.354059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:46:24.367895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) Jul 19 12:46:24.368058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] HTTP exception thrown: Instance c1b6e8ae-5267-4927-8b70-b808809b7963 could not be found. Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Request method failure captured: Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 HTTP/1.1 Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qR_RpEZpc55DaBLioc39H90leiTgGDCzJgSwAxP55zvKMe9zllQn7uqjJzSh1GISTsxz-8wHbOqxPnt0xqi2-sGK70QZVdl3Z_bT0LAb1AABsEuTzdioc5_XIZl7xzRm3ayX6yFSaAMVhUiNUW-AZAF9ApJzBrsR5xNE8RtS9VgR2g Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: b4a603ce9a934f188a137ee171d66aa7 Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestVolumeBootPattern-813727227 Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:46:24.369482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4a603ce9a934f188a137ee171d66aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4a603ce9a934f188a137ee171d66aa7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4a603ce9a934f188a137ee171d66aa7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4a603ce9a934f188a137ee171d66aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestVolumeBootPattern-813727227 Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: b4a603ce9a934f188a137ee171d66aa7 Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestVolumeBootPattern-813727227 Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-TestVolumeBootPattern-813727227-project Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 880c0417a58d48ceaab3912957f2e4a7 Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestVolumeBootPattern-813727227-project Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance c1b6e8ae-5267-4927-8b70-b808809b7963 could not be found. Jul 19 12:46:24.371625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'c1b6e8ae-5267-4927-8b70-b808809b7963'} Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b6e8ae-5267-4927-8b70-b808809b7963 could not be found. Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:46:24.372575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b6e8ae-5267-4927-8b70-b808809b7963 could not be found. Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b6e8ae-5267-4927-8b70-b808809b7963 could not be found. Jul 19 12:46:24.373845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.374954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Returning 404 to user: Instance c1b6e8ae-5267-4927-8b70-b808809b7963 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Request method failure captured: Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 HTTP/1.1 Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRwhCWuxwtHqwEaWtIpriGmsmHCGOtoB3kM1ahNyEIPaY7p7NIZkU5evHjcQ8k3Q8zGT8qYqoPLvIBbWOSvyYEoeWFvbswBeyLwlaUpKaN3BmI01RVK8t24CrN8FTpn8uOceTpuVxBtXjoQ1f5AtEPiSZDMdfCyRrYN9HGrsigEkL0 Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:46:24.375037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f6b44bed4904d50b5f1ebfc5ab34743", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 70c035662359493e86c58a3d40150eb8 Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 12:46:24.376387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'server_id': 'cadeb57a-3504-4bac-86e9-e8ef951da265', 'id': '857fe256-77d1-451e-8353-deaa74981909'} Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:46:24.377032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 12:46:24.378373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.379747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:24.380995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) Jul 19 12:46:24.383237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:46:24.384475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b1f887-adf4-4681-a70e-36617d07259b) {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:46:24.384579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f180f179-4be2-436f-9a51-e3209af4a235 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963" status: 404 len: 111 microversion: 2.1 time: 0.032083 Jul 19 12:46:24.384579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 603/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:46:24 2022] GET /compute/v2.1/servers/c1b6e8ae-5267-4927-8b70-b808809b7963 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:46:24.384751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-31d36071-d9c5-4d9b-8f25-7ef6de0603ea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909" status: 400 len: 269 microversion: 2.1 time: 0.505059 Jul 19 12:46:24.384751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 455/1058] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 12:46:23 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265/os-volume_attachments/857fe256-77d1-451e-8353-deaa74981909 => generated 269 bytes in 506 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 12:46:48.350065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:46:48.350567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:46:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:47:35.152960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:47:35.153518 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:47:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:47:54.244896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:47:54.245377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:47:56.326247 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:47:56.326735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:47:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:48:04.171356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:48:04.171825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:48:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:48:35.281430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:48:35.281984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:50:08.360704 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:50:08.361212 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:50:23.095606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [68ed09c9-7423-4667-be4e-66575e976407] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 12:50:23.096256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:23.097542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:23.101394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:23.102740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:23.109569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:23.110024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:23.110799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:23.111240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:23.135445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:50:23.211712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-034a847b-9f41-4e9e-9120-6102d127f653 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 204 len: 0 microversion: 2.1 time: 0.117702 Jul 19 12:50:23.212829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 604/1059] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:50:23 2022] DELETE /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:50:23.218433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52daa4b8-d88a-4627-ba2e-0f8e7ec16d2c] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 12:50:23.218925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:23.219631 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=16 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:23.224854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:23.225461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:23.232070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:23.232555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:23.233312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:23.233749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:23.526215 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:23.534177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-709431f3-ae9a-4f5d-a69b-79730924f48f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1724 microversion: 2.1 time: 0.317336 Jul 19 12:50:23.534731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 456/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:24.551873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:24.553221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:24.562308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:24.562914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:24.564734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:24.565400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:24.600779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] [68ed09c9-7423-4667-be4e-66575e976407] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34650. Jul 19 12:50:24.640497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52daa4b8-d88a-4627-ba2e-0f8e7ec16d2c] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34658. Jul 19 12:50:24.716769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-e03b1e46-5a58-40b3-a8af-39915de2d580 req-0283f565-36b7-45ca-b063-fb927edc46ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3", "name": "network-vif-deleted", "tag": "802e451a-2b49-4a6e-a7e6-80c9853cd706"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:50:24.726003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-e03b1e46-5a58-40b3-a8af-39915de2d580 req-0283f565-36b7-45ca-b063-fb927edc46ea service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:24.726708 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-e03b1e46-5a58-40b3-a8af-39915de2d580 req-0283f565-36b7-45ca-b063-fb927edc46ea service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:24.740046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-e03b1e46-5a58-40b3-a8af-39915de2d580 req-0283f565-36b7-45ca-b063-fb927edc46ea service nova] Creating event network-vif-deleted:802e451a-2b49-4a6e-a7e6-80c9853cd706 for instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 on hv-cinder-82099 Jul 19 12:50:24.747258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-e03b1e46-5a58-40b3-a8af-39915de2d580 req-0283f565-36b7-45ca-b063-fb927edc46ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120466 Jul 19 12:50:24.748408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 457/1061] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:50:24.985316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:24.995515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2de82611-96a9-430f-b8d0-9ddc028c5fce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1658 microversion: 2.1 time: 0.448200 Jul 19 12:50:24.996100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 605/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1658 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:26.017812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:26.018553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:26.026408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:26.026947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:26.027978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:26.028455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:26.091093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:26.098795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a732276e-8a5a-4f2f-8240-450c22a2e0f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089571 Jul 19 12:50:26.099349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 458/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:27.121632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:27.122270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:27.128719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:27.129168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:27.129927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:27.130360 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:27.191833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:27.199611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-51e72794-8a6f-4a25-ac8d-1242728e2d44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081832 Jul 19 12:50:27.200184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 606/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:28.216604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:28.217214 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:28.224331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:28.224787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:28.225549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:28.225986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:28.289287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:28.297119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-22f92059-e972-45a1-a10f-5a60bcc64df0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084579 Jul 19 12:50:28.297679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 459/1065] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:29.313884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:29.314492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:29.320931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:29.321381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:29.322136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:29.322570 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:29.386389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:29.394529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5b4e9e7e-f7a0-4b50-9679-c554b3d3e1fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084552 Jul 19 12:50:29.395104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 607/1066] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:30.411206 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:30.411811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:30.418129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:30.418574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:30.419330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:30.419760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:30.478983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:30.486718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0283e1e4-917d-4252-9f4b-e7338d63cbb5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.079345 Jul 19 12:50:30.487785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 460/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:31.503502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:31.504107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:31.510505 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:31.510949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:31.511701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:31.512131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:31.572973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:31.580694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3ea4eaea-5160-497e-b9d2-858b32ee1c2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081064 Jul 19 12:50:31.581913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 608/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:32.598427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:32.599802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:32.607004 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:32.608346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:32.609492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:32.610121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:32.676355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:32.684337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-62d8e066-0ab2-45e4-b099-fee6672dfc7c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090179 Jul 19 12:50:32.684885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 461/1069] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:33.701546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:33.702265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:33.709810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:33.710334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:33.711108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:33.711549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:33.778162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:33.786789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9887a4ec-ca6e-45cc-b58c-696d1b4f524f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089127 Jul 19 12:50:33.787355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 609/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:34.802899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:34.803441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:34.810051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:34.810499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:34.811251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:34.811683 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:34.872162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:34.879996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d75e5ded-84aa-4ddf-bcab-0604d2b87722 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081058 Jul 19 12:50:34.880597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 462/1071] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:35.896784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:35.897342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:35.903734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:35.904200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:35.904958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:35.905390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:35.965267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:35.974700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cdc26946-1ba0-46eb-a150-796500bed419 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081713 Jul 19 12:50:35.975297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 610/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:36.992197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:36.992817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:36.999201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:36.999651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:37.000444 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:37.000896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:37.060349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:37.068039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3981a42a-effe-4f06-9938-06001afffa19 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081138 Jul 19 12:50:37.068622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 463/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:38.085518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:38.086130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:38.092619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:38.093071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:38.093833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:38.094271 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:38.164572 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:38.173965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d0d92ff-26bf-4716-93fc-d051c274c191 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.092331 Jul 19 12:50:38.174562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 611/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:39.191881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:39.192512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:39.198899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:39.199377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:39.200130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:39.200590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:39.260012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:39.269250 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6dfb1089-ffed-4c1c-8d94-e5b2b0287da9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081145 Jul 19 12:50:39.269825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 464/1075] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:40.286494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:40.287138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:40.293662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:40.294109 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:40.294867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:40.295298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:40.355519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:40.364016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0ec66f75-d852-4983-908f-86a92211e21e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081787 Jul 19 12:50:40.364605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 612/1076] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:41.381079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:41.381688 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:41.388369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:41.388818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:41.389573 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:41.390007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:41.454669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:41.462776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-96b10e55-02d4-4e61-b522-fd215fcead28 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085992 Jul 19 12:50:41.463371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 465/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:42.479990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:42.480635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:42.487622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:42.488075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:42.488868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:42.489309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:42.553611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:42.561449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9ad0623b-9551-40e5-b897-550916f92be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085320 Jul 19 12:50:42.562012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 613/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:43.577723 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:43.578331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:43.585366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:43.585818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:43.586581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:43.587018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:43.648126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:43.656474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b5aa5df8-2019-4bf5-b88a-18c17498d1a3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082458 Jul 19 12:50:43.657181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 466/1079] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:44.673737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:44.674353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:44.681016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:44.681471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:44.682241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:44.682678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:44.743036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:44.751796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d711fcc-d8e7-4225-9943-16da69e0ca37 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081991 Jul 19 12:50:44.752385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 614/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:45.768617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:45.769258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:45.775769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:45.776241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:45.777000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:45.777439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:45.837042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:45.844784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1df1b694-1d44-46aa-8970-a11c3f6ec838 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.079995 Jul 19 12:50:45.845365 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 467/1081] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:46.861929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:46.862539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:46.869567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:46.869958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:46.870720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:46.871156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:46.934884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:46.943971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c173c87f-d29b-48e0-a79d-fa53a6ef2777 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085469 Jul 19 12:50:46.944797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 615/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:47.960624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:47.961182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:47.967536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:47.967982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:47.968774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:47.969206 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:48.029516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:48.037258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e38ae6b0-71f1-4478-81cf-fefa92bf9347 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081100 Jul 19 12:50:48.037819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 468/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:49.054975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:49.055917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:49.064266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:49.064722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:49.065506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:49.065942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:49.126157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:49.134077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-844f48e5-82d9-4b62-b1da-ecaef6ddf5c7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084154 Jul 19 12:50:49.134636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 616/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:50.151270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:50.151901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:50.158457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:50.158911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:50.159674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:50.160114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:50.220107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:50.228673 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cd0afcb9-6c07-4ace-9063-f93143247b08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081253 Jul 19 12:50:50.229245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 469/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:51.244826 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:51.245426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:51.251907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:51.252400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:51.253160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:51.253599 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:51.317109 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:51.324858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f30a196c-c52d-41d7-b861-dc8727261edb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083945 Jul 19 12:50:51.325424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 617/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:52.342069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:52.342679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:52.349912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:52.350360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:52.351120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:52.351551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:52.411969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:52.419788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2db2ecc0-0b16-40df-8a66-d1da1d3c78ff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081573 Jul 19 12:50:52.420371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 470/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:53.436409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:53.437021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:53.439565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:53.445445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:53.445896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:53.446651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:53.447083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:53.450496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:53.514586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:53.523073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a1ce1bd-1b73-4d26-952d-2ad129af5144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090559 Jul 19 12:50:53.523627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 618/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:54.540443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:54.541051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:54.543416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=31 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:54.548668 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:54.549136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:54.549902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:54.550340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:54.554346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=87 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:54.610791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:54.618886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-881857ba-0166-423a-8994-77f9e33064e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082266 Jul 19 12:50:54.619450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 471/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:55.161062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:50:55.161317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:50:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:50:55.635221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:55.635866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:55.642302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:55.642757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:55.643534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:55.643975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:55.710893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:55.718817 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1c372c6-c661-4cd1-983a-e045cf8378e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.087670 Jul 19 12:50:55.719387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 619/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:56.736480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:56.737087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:56.743662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:56.744110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:56.744897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:56.745331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:56.810032 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:56.818499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d3924e34-68e8-44d5-b282-cb0baf82c9cf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085994 Jul 19 12:50:56.819059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 472/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:57.835646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:57.836277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:57.842771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:57.843226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:57.843988 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:57.844448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:57.906638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:57.914485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cdfccd8f-dc50-4418-97bc-377c2a3bc853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083496 Jul 19 12:50:57.915044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 620/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:50:58.931227 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:50:58.931779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:50:58.938209 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:58.938665 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:58.939426 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:50:58.939866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:50:59.145463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:50:59.153825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0769399b-736d-481b-9aa2-6d9379156bfe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.226765 Jul 19 12:50:59.154377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 473/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:50:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:00.171083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:00.171700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:00.178314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:00.178762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:00.179525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:00.179963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:00.242736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:00.250658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a73c8cbb-e135-4567-a060-cfd6a6ba2b1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083477 Jul 19 12:51:00.251219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 621/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:51:01.267677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:01.268317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:01.274792 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:01.275249 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:01.276010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:01.276486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:01.335989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:01.344083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-165cef87-d95f-43ee-8e50-d1cd17c81144 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080221 Jul 19 12:51:01.344675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 474/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:02.360774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:02.361405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:02.368398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:02.368852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:02.369612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:02.370051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:02.430889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:02.438713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-89404fbd-523f-459f-b8b2-c92c1e054c97 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081863 Jul 19 12:51:02.439274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 622/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:03.454879 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:03.455514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:03.462431 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:03.462875 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:03.463627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:03.464057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:03.524835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:03.532538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bce90ef4-27d6-47ef-a103-dc5af7aea74e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081486 Jul 19 12:51:03.533089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 475/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:04.549641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:04.550165 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:04.556485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:04.556934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:04.557691 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:04.558122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:04.620886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:04.628810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6180d0cd-781c-447c-b5bf-dc1dd74a7fc5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083003 Jul 19 12:51:04.629368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 623/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:05.646464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:05.647084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:05.653911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:05.654369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:05.655137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:05.655585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:05.716287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:05.724986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c340be3d-d7da-444c-a037-67bb5da8f0eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082238 Jul 19 12:51:05.725549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 476/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:06.742134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:06.742775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:06.749392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:06.749848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:06.750615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:06.751055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:06.812050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:06.819862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-12db6024-fc47-43db-ad02-6505a824a804 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082244 Jul 19 12:51:06.820459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 624/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:07.837143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:07.837784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:07.844449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:07.844901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:07.845663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:07.846098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:07.907010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:07.915283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7b68e707-406c-4265-bce9-25df61cd64a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082628 Jul 19 12:51:07.915837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 477/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:08.932832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:08.933378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:08.939609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:08.940058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:08.940885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:08.942034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:09.005835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:09.014007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d722124-ddc6-4462-a31d-5e2fd4c6b0f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085246 Jul 19 12:51:09.014568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 625/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:10.030470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:10.031095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:10.038089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:10.038546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:10.039317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:10.039760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:10.103962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:10.115976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-08871327-e383-4a36-b60e-f67fabab1c49 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089093 Jul 19 12:51:10.116878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 478/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:11.132532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:11.133184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:11.139894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:11.140385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:11.141152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:11.141615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:11.203910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:11.212369 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c94a5377-a897-4172-9560-c8e878a79899 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083748 Jul 19 12:51:11.212930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 626/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:12.229088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:12.229696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:12.236027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:12.236509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:12.237259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:12.237692 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:12.298098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:12.305952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1dfafd3a-99e1-40f8-aaad-1ff9eb3e9078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080734 Jul 19 12:51:12.306526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 479/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:13.323007 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:13.323607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:13.330088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:13.330531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:13.331283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:13.331716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:13.401003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:13.408876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-95c03891-8282-4479-9fcb-10b083a3a696 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089711 Jul 19 12:51:13.409434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 627/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:14.253708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:51:14.253934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:51:14.424527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:14.425134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:14.431488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:14.431935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:14.432729 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:14.433165 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:14.492887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:14.500564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8cefccde-5fec-41e1-8703-9e6bb028d702 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.079847 Jul 19 12:51:14.501123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 480/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:15.518353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:15.518977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:15.525566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:15.526018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:15.526786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:15.527224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:15.589403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:15.597358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f3917404-517b-4d06-8d9f-506812e4306c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082949 Jul 19 12:51:15.597919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 628/1108] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:16.334536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:51:16.335035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:51:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:51:16.614177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:16.614790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:16.621413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:16.621865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:16.622632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:16.623071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:16.683860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:16.691813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5cc69118-c41b-43c3-9a4d-5c52ba2e5328 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081695 Jul 19 12:51:16.692916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 481/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:17.709536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:17.710150 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:17.716721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:17.717178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:17.717938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:17.718372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:17.781688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:17.790350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c57e2a19-7a4e-40bb-aa7b-cb7df22746bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085196 Jul 19 12:51:17.790911 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 629/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:18.807186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:18.807794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:18.814298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:18.814745 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:18.815500 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:18.815937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:18.875765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:18.883589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-489e5e56-f1cc-4541-b824-a529a15d522e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080202 Jul 19 12:51:18.884142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 482/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:19.900617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:19.901237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:19.907577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:19.908028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:19.908829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:19.909267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:19.968815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:19.976640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-126c8456-d6ba-43e4-b279-5785e9ec76b8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.079885 Jul 19 12:51:19.977199 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 630/1112] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:20.993089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:20.993700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:21.000094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:21.000570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:21.001331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:21.001764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:21.061804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:21.070135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0ae9fba6-7418-4bdb-9baa-c5ba7e7bb676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080882 Jul 19 12:51:21.070687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 483/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:22.087365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:22.087981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:22.094772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:22.095274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:22.096144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:22.096624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:22.160299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:22.168128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c33da9a-f57e-48e7-8b0d-dbd0a9fcb856 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085231 Jul 19 12:51:22.168714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 631/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:23.184776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:23.185389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:23.191835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:23.192834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:23.193603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:23.194042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:23.259545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:23.268951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0c563a99-ec3d-4307-81a3-3d392ba4bbe1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086967 Jul 19 12:51:23.269521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 484/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:24.284854 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:24.285469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:24.288289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=28 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:24.293502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:24.293990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:24.294760 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:24.295196 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:24.298058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:24.359323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:24.367469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bec24810-4896-4f29-9c0a-c5eea2125e64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086479 Jul 19 12:51:24.368042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 632/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:25.384286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:25.384893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:25.386919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=28 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:25.392848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:25.393351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:25.394188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:25.394632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:25.397940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=84 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:25.462566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:25.470511 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c517fbd1-2744-4095-a6e7-3dddf2f9038b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090091 Jul 19 12:51:25.471072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 485/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:26.487072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:26.487682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:26.494354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:26.494808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:26.495567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:26.496003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:26.559629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:26.567559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-39bc40eb-a093-4563-a09d-15c58e99deca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084512 Jul 19 12:51:26.568111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 633/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:27.583728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:27.584376 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:27.593392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:27.593943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:27.594718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:27.595163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:27.655947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:27.663701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-604591dc-afcb-4a6a-8cd1-94f347a50a26 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083872 Jul 19 12:51:27.664279 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 486/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:28.681318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:28.681927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:28.689201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:28.689697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:28.690617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:28.691041 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:28.752395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:28.760368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1229cc7-5411-48ed-8021-2fff413f1f23 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083885 Jul 19 12:51:28.760931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 634/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:29.777177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:29.777790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:29.784299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:29.784749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:29.785509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:29.786611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:29.854460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:29.862484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1ca94ff4-b286-4a24-8a5d-5f2cd5ca6933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089193 Jul 19 12:51:29.863036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 487/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:30.879543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:30.880058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:30.886499 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:30.886944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:30.887765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:30.888475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:30.948709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:30.956538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b452c85c-ea0d-48cc-bf3f-7d0b4936a493 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080938 Jul 19 12:51:30.957089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 635/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:31.973936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:31.974479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:31.980880 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:31.981331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:31.982101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:31.982570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:32.042498 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:32.050244 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ea25040c-4b08-491e-943e-0bed449a8c87 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080347 Jul 19 12:51:32.050801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 488/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:33.066871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:33.067513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:33.074025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:33.074477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:33.075235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:33.075672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:33.137029 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:33.145158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8398366-b7b2-4473-b0ca-247b0cf222f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082179 Jul 19 12:51:33.145714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 636/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:34.161719 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:34.162365 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:34.168961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:34.169415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:34.170180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:34.170644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:34.233607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:34.241964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ff016f1c-23a1-4ccd-ab67-19c9a8b6f152 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084076 Jul 19 12:51:34.242551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 489/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:35.259087 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:35.259700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:35.266456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:35.266912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:35.267674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:35.268111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:35.328035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:35.336507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d70afa8a-e8c5-410c-815c-5c1cb1982336 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081818 Jul 19 12:51:35.337068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 637/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:36.353557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:36.354183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:36.360823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:36.361190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:36.361954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:36.362393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:36.423010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:36.430895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f0593f7e-9fe7-4098-9ebb-0d65bc1a5676 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081172 Jul 19 12:51:36.431455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 490/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:37.447970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:37.448610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:37.455042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:37.455492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:37.456282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:37.456719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:37.516578 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:37.524447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-758c3c0d-17fb-4203-b3c4-cfdd39eda553 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080356 Jul 19 12:51:37.525009 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 638/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:38.541116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:38.541725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:38.548120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:38.548603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:38.549367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:38.549804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:38.616416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:38.624422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d5e954df-d87e-4bd8-9c67-bd78293fc9a8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.087239 Jul 19 12:51:38.624974 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 491/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:39.642078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:39.642694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:39.649399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:39.649883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:39.650726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:39.651214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:39.714657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:39.722622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cda20bfa-3b1a-4ba3-aa6a-7a106d55792e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084750 Jul 19 12:51:39.723194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 639/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:40.738944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:40.739554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:40.746192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:40.746679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:40.747446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:40.747885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:40.809449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:40.817184 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b8fb29d9-a662-4532-9bfd-edf563e36390 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082150 Jul 19 12:51:40.817739 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 492/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:41.834126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:41.834734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:41.841235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:41.841688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:41.842449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:41.842883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:41.903354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:41.911188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-092cefe6-2c2d-4a78-a7c1-63aa61096b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080898 Jul 19 12:51:41.912249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 640/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:42.929070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:42.929598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:42.936048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:42.936539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:42.937309 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:42.937754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:43.000556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:43.009166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5e373279-0d69-4a35-9069-3989a890095a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084617 Jul 19 12:51:43.009769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 493/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:44.027738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:44.028346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:44.034814 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:44.035260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:44.036021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:44.036486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:44.096777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:44.104755 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3cdb0768-afd6-4ef9-915f-00379a81d51c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082230 Jul 19 12:51:44.105311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 641/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:45.121239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:45.121843 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:45.128300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:45.128749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:45.129504 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:45.129939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:45.190104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:45.197941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-76f2dd61-6c80-4510-86cf-c300e0d595e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080575 Jul 19 12:51:45.198493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 494/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:46.213655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:46.214173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:46.220611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:46.221059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:46.221810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:46.222238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:46.282104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:46.290300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc24e1ec-2237-495d-950d-288f9c44f551 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080676 Jul 19 12:51:46.290853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 642/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:47.307470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:47.307990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:47.314387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:47.314834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:47.315588 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:47.316050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:47.379228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:47.387666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9fc98a17-f01f-4c7f-9db7-61a573f21b9a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084656 Jul 19 12:51:47.388240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 495/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:48.404620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:48.405228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:48.412162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:48.412410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:48.413219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:48.413652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:48.474056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:48.481879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d63f0ea-b68c-4434-a2ca-5932cfa808f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081136 Jul 19 12:51:48.482434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 643/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:49.498583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:49.499195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:49.505799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:49.506248 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:49.507007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:49.507441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:49.567487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:49.575233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f90b6694-bfba-446b-b52e-f280db855d2f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080475 Jul 19 12:51:49.575786 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 496/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:50.591788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:50.592443 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:50.598971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:50.599449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:50.600736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:50.601172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:50.660856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:50.669177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-932d3693-92d8-46ad-894c-559bcbcf0be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081285 Jul 19 12:51:50.669731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 644/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:51.685649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:51.686294 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:51.692802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:51.693252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:51.694676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:51.695111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:51.759981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:51.768134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-62e8d605-9eee-4890-b004-78e440191ab9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086326 Jul 19 12:51:51.768730 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 497/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:52.785252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:52.785867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:52.792893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:52.793347 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:52.794104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:52.794536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:52.855020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:52.862952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8cb054d-bd78-419c-8f07-1d5bffbd7604 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081449 Jul 19 12:51:52.863466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 645/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:53.880143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:53.880735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:53.887620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:53.888071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:53.889120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:53.889559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:53.950131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:53.957873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-574092a7-4aa0-46c2-8be2-ed15095cfb9c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081698 Jul 19 12:51:53.958425 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 498/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:54.973853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:54.974457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:54.976575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=28 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:54.981864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:54.982307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:54.983060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:54.983500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:54.987496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:55.046486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:55.055159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e78d4d4c-2a19-43c6-bed0-12a8a574678e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085203 Jul 19 12:51:55.055719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 646/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:56.071990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:56.072642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:56.074657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=28 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:56.079851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:56.080326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:56.081090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:56.081526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:56.085578 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=84 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:56.144386 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:56.152576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-77e9ce1b-bb61-4cc2-b0bb-41838c7da20b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084635 Jul 19 12:51:56.153136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 499/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:57.169811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:57.170455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:57.176910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:57.177358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:57.178115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:57.178867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:57.239229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:57.247331 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dd5465c7-a0c3-4d60-bdb5-7c82f4dd8dd7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081445 Jul 19 12:51:57.247896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 647/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:58.264040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:58.264693 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:58.271430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:58.271889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:58.273293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:58.273736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:58.333015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:58.350272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-32759b07-0f01-46a7-b002-eb3d9de5d06b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090139 Jul 19 12:51:58.350861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 500/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:51:59.366883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:51:59.367577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:51:59.374004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:59.374450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:59.375205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:51:59.375635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:51:59.435540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:51:59.443412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-72ca18cd-06b3-40f3-9d4f-ee55ae8a623a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080398 Jul 19 12:51:59.443967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 648/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:51:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:00.459896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:00.460603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:00.466976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:00.467423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:00.468187 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:00.468633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:00.531932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:00.540253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-826c7be5-cfec-46c9-986f-e5d68e3fbe69 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084196 Jul 19 12:52:00.540809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 501/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:01.556701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:01.557289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:01.563773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:01.564248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:01.565011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:01.565440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:01.625608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:01.633452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c9c21f5-c230-4adf-92ec-20316cf1452e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080577 Jul 19 12:52:01.634018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 649/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:02.650390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:02.650929 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:02.657414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:02.657861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:02.658618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:02.659052 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:02.718605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:02.726877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6b1d96bc-8290-4f8e-a467-f08a34f90574 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.079880 Jul 19 12:52:02.727433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 502/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:03.743847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:03.744486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:03.750879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:03.751353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:03.752116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:03.752580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:03.812844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:03.821296 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-55348613-572f-4cee-964e-ae6b453594b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081841 Jul 19 12:52:03.821859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 650/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:04.838698 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:04.839321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:04.845789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:04.846251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:04.847019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:04.847467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:04.909892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:04.917834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7fc73083-000c-4eee-8f03-eadc3b149672 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083619 Jul 19 12:52:04.918395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 503/1153] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:05.934642 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:05.935177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:05.941710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:05.942493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:05.943257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:05.943733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:06.003901 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:06.011819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb349f03-e501-40c1-8e3f-515b292ee54b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081101 Jul 19 12:52:06.012413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 651/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:07.028697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:07.029329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:07.035659 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:07.036138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:07.036924 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:07.037358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:07.098127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:07.106354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-87e3ff76-1599-48b1-80a9-c2350547c1dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081493 Jul 19 12:52:07.106911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 504/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:08.123561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:08.124203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:08.130661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:08.131111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:08.131871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:08.132344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:08.194866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:08.203323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce9a96c8-3549-417f-bdbb-c34052f24394 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083626 Jul 19 12:52:08.203888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 652/1156] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:09.220487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:09.221104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:09.227502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:09.227958 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:09.228763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:09.229238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:09.296871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:09.305418 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ac9225ac-9e8a-4e17-96cf-e84889c5a5eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088821 Jul 19 12:52:09.306224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 505/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:10.323218 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:10.323848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:10.329993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:10.330444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:10.331346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:10.331793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:10.393064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:10.401113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e335401-3e71-4309-89f3-0f47a3eb2586 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082648 Jul 19 12:52:10.401675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 653/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:11.419158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:11.419804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:11.426239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:11.426690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:11.427483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:11.427918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:11.490324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:11.498129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-04bd51ff-28e1-4480-b64b-81a213f507a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082914 Jul 19 12:52:11.498697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 506/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:12.515083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:12.515694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:12.522392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:12.522883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:12.523643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:12.524081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:12.583600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:12.591329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a5a8da4-e7a7-4201-b724-c4b2c00d82fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080448 Jul 19 12:52:12.591895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 654/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:13.607976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:13.608756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:13.615296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:13.615753 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:13.617048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:13.617486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:13.681018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:13.689080 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-49c98150-7c0c-42f3-8fce-2b5062554931 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084973 Jul 19 12:52:13.691409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 507/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:14.705784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:14.706339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:14.712897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:14.713348 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:14.714108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:14.714544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:14.774553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:14.782286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af714ee3-4d7d-4f00-9003-37e0b61c001e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080434 Jul 19 12:52:14.782850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 655/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:15.798878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:15.799499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:15.806446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:15.806906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:15.807674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:15.808119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:15.868235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:15.876101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dd10e8a0-2193-48ac-92a6-d736748f4536 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081129 Jul 19 12:52:15.876695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 508/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:16.893610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:16.894229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:16.901359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:16.901816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:16.902581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:16.903022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:16.962904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:16.970716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9cfeff73-8a39-4caa-a15a-a6a5d22d2e38 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080961 Jul 19 12:52:16.971284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 656/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:17.987514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:17.988130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:17.994736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:17.995198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:17.995964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:17.996435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:18.059347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:18.067109 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e89ae78a-e1ec-4289-bb2d-8cb9a84a91ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083473 Jul 19 12:52:18.067668 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 509/1165] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:19.083680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:19.084333 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:19.090755 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:19.091207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:19.091997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:19.092457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:19.152722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:19.160649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0e2ed763-9dce-48d1-9dd3-3a3b34aa21fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080815 Jul 19 12:52:19.161215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 657/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:20.177788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:20.178406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:20.185497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:20.185954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:20.186718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:20.187163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:20.246738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:20.254503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8bca1c98-5ed8-4fa8-8bdc-32ffe20da03a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080646 Jul 19 12:52:20.255068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 510/1167] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:21.271909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:21.272569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:21.279556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:21.280005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:21.280795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:21.281225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:21.340722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:21.348594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ca5005e-d633-491d-bf61-0fd5f90e1083 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080516 Jul 19 12:52:21.349164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 658/1168] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:22.365271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:22.365884 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:22.372894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:22.373352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:22.374115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:22.374556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:22.438632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:22.446624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-36abd588-fe89-4f78-9c12-9fb2117fc8a9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085241 Jul 19 12:52:22.447184 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 511/1169] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:23.462915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:23.463520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:23.470323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:23.470773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:23.471548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:23.471987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:23.534234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:23.542611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a1d863e6-bcae-4d3a-bb7e-b246e2147fd0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083564 Jul 19 12:52:23.543182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 659/1170] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:24.559935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:24.560572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:24.567104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:24.567543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:24.568339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:24.568787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:24.628939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:24.636839 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-47817931-0879-4088-8a9d-8e97b51f7853 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080758 Jul 19 12:52:24.637337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 512/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:25.089797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:25.090337 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:25.093747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=28 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:25.097615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:25.098069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:25.099330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:25.100129 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:25.105859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:25.130296 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:52:25.216166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-84f80929-ff6c-4d64-8ddf-a69c18c89a23 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] Calling method '.version_select at 0x7fd994327040>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:25.221471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab76bcf2-86b6-4ed8-ab81-9fbf0d9acb5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 204 len: 0 microversion: 2.1 time: 0.135852 Jul 19 12:52:25.222593 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 660/1172] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:52:25 2022] DELETE /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:52:25.233947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:25.234829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:25.241172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:25.241908 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:25.242954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:25.243464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:25.248891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-84f80929-ff6c-4d64-8ddf-a69c18c89a23 tempest-TestVolumeBootPattern-813727227 tempest-TestVolumeBootPattern-813727227-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2096215092" status: 202 len: 0 microversion: 2.1 time: 0.037000 Jul 19 12:52:25.248891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 513/1173] 10.222.0.13 () {58 vars in 1262 bytes} [Tue Jul 19 12:52:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2096215092 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 12:52:25.387219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:25.396423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-66f0e98b-fe33-4ef6-949e-387f5f7ec0c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.167181 Jul 19 12:52:25.397181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 661/1174] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:25 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:25.653873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:25.654639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:25.661100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:25.661649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:25.662534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:25.663045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:25.754720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:25.764255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-112a33e3-81e5-4e4f-8763-afb9e083440b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.114052 Jul 19 12:52:25.765186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 514/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:26.420957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:26.421584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:26.430707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:26.431157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:26.431935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:26.432573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:26.568206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:26.576810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5743ec29-0371-4ac8-8209-af7d5540dddd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.165810 Jul 19 12:52:26.577390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 662/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:26 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:26.781298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:26.781876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:26.784232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:26.789942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:26.790403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:26.791180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:26.791677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:26.796666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=90 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:26.857463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:26.865497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5ba3b874-4554-40e9-ad02-6e851c9e3bd4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088155 Jul 19 12:52:26.866149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 515/1177] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:27.594398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:27.595016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:27.601790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:27.602244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:27.603273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:27.603713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:27.745062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:27.753268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-216a4822-30b4-4da5-ad7e-f4dc715a20a5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.162743 Jul 19 12:52:27.754074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 663/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:27 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:27.883355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:27.883968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:27.890768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:27.891220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:27.891985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:27.892474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:27.953476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:27.961917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c701830c-23f2-44db-8aa6-46ec379b0078 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083035 Jul 19 12:52:27.962487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 516/1179] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:28.777465 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:28.778467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:28.786524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:28.786979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:28.787760 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:28.788252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:28.924771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:28.933132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c82f5ce0-0f57-4a29-a4d8-7867550cb1c9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.162617 Jul 19 12:52:28.933720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 664/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:28 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:28.978853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:28.979633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:28.986453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:28.986911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:28.987692 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:28.988132 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:29.050660 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:29.062319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dd949700-0a7c-41dc-948a-a8108e785509 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086998 Jul 19 12:52:29.063289 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 517/1181] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:29.950987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:29.951690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:29.958102 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:29.958785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:29.959557 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:29.960005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:30.080516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:30.081541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:30.088593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:30.089170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:30.089754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:30.090300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:30.090972 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:30.098581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7674c75a-6345-4631-a452-521672c19396 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151450 Jul 19 12:52:30.099472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 665/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:29 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:30.158471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:30.166324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b8184bea-bf74-4bc8-a324-a884873afaa0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089778 Jul 19 12:52:30.167474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 518/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:52:31.120115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:31.120960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:31.128395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:31.128857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:31.129642 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:31.130820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:31.184286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:31.185564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:31.191705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:31.192404 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:31.193189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:31.193615 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:31.284561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:31.292787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-28c7e2f4-ba6e-4944-b3b6-ad6ed09456ca tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.112434 Jul 19 12:52:31.293384 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 519/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:52:31.361533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:31.370031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-556b0d80-6339-4221-b332-adc0ebbe805a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.253998 Jul 19 12:52:31.370534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 666/1185] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:31 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:32.309274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:32.309885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:32.316449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:32.316904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:32.317664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:32.318098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:32.386882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:32.387575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:32.394397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:32.398410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:32.401206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:32.403069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:32.403995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5bb5c1c7-4f83-4ac2-980a-cc5d1f44c7b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.098519 Jul 19 12:52:32.404928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 520/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:32.414225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:32.560202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:32.568451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb0782ee-acf9-4be2-9324-3372c4b5c161 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.185463 Jul 19 12:52:32.569018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 667/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:32 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:33.421677 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:33.422306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:33.429970 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:33.430428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:33.431207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:33.431652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:33.492009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:33.500225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6d4bd029-4e4e-4990-8d9b-6503e6dca0e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082512 Jul 19 12:52:33.500794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 521/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:33.585895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:33.586508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:33.593005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:33.593453 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:33.594216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:33.594651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:33.720725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:33.729210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a98bd19f-ee05-48a7-a455-ec7628c148a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147111 Jul 19 12:52:33.729775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 668/1189] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:33 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:34.517368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:34.517981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:34.524932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:34.525389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:34.526153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:34.526594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:34.590251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:34.598054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ab2c05ed-dd71-42a9-a267-9ba7e607b9e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084789 Jul 19 12:52:34.598610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 522/1190] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:34.746616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:34.747226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:34.753637 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:34.754096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:34.754860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:34.755298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:34.881104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:34.889706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-44fb69b7-c3d5-4321-9921-ea1d665d6428 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146939 Jul 19 12:52:34.890277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 669/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:34 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:35.615199 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:35.615819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:35.622344 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:35.622800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:35.623569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:35.624010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:35.685812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:35.693873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-08f33df7-38e6-477c-9898-d11b3a5097b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082636 Jul 19 12:52:35.694940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 523/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:35.907179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:35.907721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:35.914933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:35.915384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:35.916146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:35.916616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:36.050544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:36.058507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-23a77fc2-fa9c-445d-986b-6eb562b538cc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.155252 Jul 19 12:52:36.059072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 670/1193] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:35 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:36.711397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:36.711929 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:36.718393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:36.718848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:36.719608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:36.720047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:36.780856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:36.789364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-93531104-b90c-4307-bf0a-c9e4ea21be6b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082400 Jul 19 12:52:36.789925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 524/1194] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:37.076051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:37.076701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:37.083137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:37.083592 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:37.084393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:37.085426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:37.210536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:37.218369 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-990b662f-bf35-42b0-87ed-535d9bc90558 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146261 Jul 19 12:52:37.218941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 671/1195] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:37 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:37.806320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:37.806938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:37.813816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:37.814278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:37.815049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:37.815497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:37.882414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:37.890519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2e772c47-681b-44bb-ab5d-1f2f5edda565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088657 Jul 19 12:52:37.891085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 525/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:38.234872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:38.235485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:38.242091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:38.242541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:38.243305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:38.243744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:38.371588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:38.379414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da972855-1690-4e14-bf5c-2df938f926c5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148413 Jul 19 12:52:38.380004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 672/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:38 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:38.907162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:38.907705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:38.914102 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:38.914557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:38.915319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:38.915760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:38.976493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:38.984246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6c408d67-e512-4a52-adc3-b4f2c60dd14d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080966 Jul 19 12:52:38.984813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 526/1198] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:39.396440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:39.397082 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:39.403562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:39.404010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:39.404809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:39.405247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:39.533393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:39.541724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f72535b1-92e0-4f10-8ec2-e6ee65350602 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149220 Jul 19 12:52:39.542313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 673/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:39 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:40.001181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:40.001817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:40.009205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:40.009651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:40.010407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:40.010842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:40.072054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:40.080014 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e583d328-96a2-4fc3-be66-cbfd214e82e6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082625 Jul 19 12:52:40.080607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 527/1200] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:40.559380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:40.559986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:40.566529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:40.566974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:40.567724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:40.568160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:40.694056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:40.702481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ca35a404-6c66-4c9e-9bd9-11e0d2c19978 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147592 Jul 19 12:52:40.703040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 674/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:40 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:41.097154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:41.097758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:41.104918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:41.105364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:41.106118 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:41.106552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:41.169737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:41.177548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-db2a5490-7739-4c12-8c77-3027455d2a55 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084202 Jul 19 12:52:41.178100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 528/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:52:41.719586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:41.720229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:41.726660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:41.727111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:41.727874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:41.728342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:41.730971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:41.856390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:41.864324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47faaa1f-1866-4f92-8241-8827e3d97280 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148495 Jul 19 12:52:41.864829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 675/1203] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:41 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:42.194178 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:42.194712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:42.201725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:42.202178 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:42.202949 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:42.203388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:42.266640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:42.274703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5395f131-ef23-4e96-906f-76ea100f2b1e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084444 Jul 19 12:52:42.275271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 529/1204] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:42.881896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:42.882432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:42.889403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:42.889844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:42.890610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:42.891132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:43.020222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:43.028588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a5706d1-4737-45f6-9feb-03b15a979005 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150637 Jul 19 12:52:43.029152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 676/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:42 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:43.290758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:43.291395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:43.297811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:43.298258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:43.299023 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:43.299452 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:43.359137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:43.366941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-88da9cfd-390c-4076-b904-dab1148f2d34 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080039 Jul 19 12:52:43.367496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 530/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:44.046275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:44.046915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:44.053531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:44.053979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:44.054738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:44.055174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:44.183981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:44.192228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc03a51c-6eaa-435e-b059-fe22541e38bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149706 Jul 19 12:52:44.192797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 677/1207] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:44 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:44.384149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:44.384711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:44.391405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:44.392276 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:44.392637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:44.393079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:44.459132 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:44.461302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:44.468785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b5905f8b-913a-4c92-b451-280753272d43 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088550 Jul 19 12:52:44.469352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 531/1208] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:45.209240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:45.209842 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:45.216313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:45.216767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:45.217524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:45.217954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:45.344998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:45.353350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3fb9b01a-1ef9-4390-8ea8-a6ddc0bfef4d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147441 Jul 19 12:52:45.353926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 678/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:45 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:45.485181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:45.485793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:45.492356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:45.492811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:45.494183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:45.494620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:45.553459 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:45.561931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-12b67930-9d82-4dac-b06e-cbab2cd96e0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080591 Jul 19 12:52:45.562489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 532/1210] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:46.371178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:46.371788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:46.378196 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:46.378641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:46.379393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:46.379852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:46.516799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:46.524794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7fe5ba85-adc6-475f-afa0-2de0e68dab8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.158075 Jul 19 12:52:46.525371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 679/1211] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:46 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:46.577954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:46.578572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:46.584977 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:46.585435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:46.586205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:46.586649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:46.647483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:46.655381 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-05e00f00-a7cb-45e2-a555-64f0a308b157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081199 Jul 19 12:52:46.655951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 533/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:47.541897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:47.542511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:47.548961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:47.549417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:47.550189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:47.550627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:47.672028 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:47.672663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:47.677732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:47.679322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:47.679794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:47.680599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:47.681527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:47.686086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-322f7d32-2226-4e81-a7c2-decea4bbb677 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148029 Jul 19 12:52:47.686653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 680/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:47 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:47.745145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:47.753035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e853f917-3067-4815-8a80-ff14ec72ac44 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084853 Jul 19 12:52:47.753607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 534/1214] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:52:48.702771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:48.703421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:48.709934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:48.710401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:48.711146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:48.711583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:48.770879 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:48.771632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:48.778596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:48.779123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:48.779986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:48.780514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:48.848785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:48.857035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9771a5d3-e28b-4f54-a25f-035979c62d8c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090058 Jul 19 12:52:48.857596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 535/1215] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:52:48.863061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:48.871219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-48c2e306-be89-4edc-aee3-454c111504bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.172238 Jul 19 12:52:48.871713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 681/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:48 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:49.874503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:49.875053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:49.881574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:49.882030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:49.882799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:49.883243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:49.887661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:49.888307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:49.894888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:49.895335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:49.896095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:49.896564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:49.949628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:49.957947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6658482a-4608-4b71-a63b-0fc5811181bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.087402 Jul 19 12:52:49.958532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 536/1217] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:50.041993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:50.050324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a90d0bbf-2480-4330-b6a0-015579d7e624 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.166397 Jul 19 12:52:50.050892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 682/1218] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:49 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:52:50.973918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:50.974529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:50.980977 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:50.981431 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:50.982195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:50.982631 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:51.042859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:51.050723 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-79477bfd-4b08-47fb-8d86-dd0bf974a7f5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080619 Jul 19 12:52:51.051233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 537/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:51.067389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:51.068026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:51.074996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:51.075441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:51.076216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:51.076652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:51.205856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:51.213851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9606cefa-8cc4-4d87-81ec-08ee2d829d02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150266 Jul 19 12:52:51.214417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 683/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:51 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:52.067740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:52.068403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:52.076300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:52.076750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:52.077509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:52.077942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:52.139998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:52.147893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-eaaad33a-19db-42d6-9875-32786543b72f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083965 Jul 19 12:52:52.148488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 538/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:52.230789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:52.231446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:52.237799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:52.238249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:52.239012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:52.239449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:52.364477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:52.372848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec19e74f-b873-47cb-8df0-2a2485cb3f2f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145948 Jul 19 12:52:52.373413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 684/1222] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:52 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:53.165865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:53.166472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:53.172943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:53.173393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:53.174169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:53.174587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:53.239142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:53.247150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d243ffe3-3c7c-40b2-9cc9-f3b20a518790 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085745 Jul 19 12:52:53.247709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 539/1223] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:53.390052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:53.390702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:53.397175 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:53.397632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:53.398403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:53.398844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:53.526558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:53.534404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c755a00d-742c-491f-aafa-4ee681031851 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148535 Jul 19 12:52:53.534979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 685/1224] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:53 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:54.262931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:54.263537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:54.270148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:54.270598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:54.271351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:54.271785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:54.332102 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:54.339947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-39fa70d3-d4c6-4f09-afb6-b48bddaedb41 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080922 Jul 19 12:52:54.340550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 540/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:54.550786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:54.551328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:54.558353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:54.558798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:54.559552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:54.559981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:54.690561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:54.698322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0a3a83e6-075b-4583-8e79-c81c1e1cc546 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151457 Jul 19 12:52:54.698880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 686/1226] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:54 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:55.356672 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:55.357282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:55.363367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:55.363814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:55.364595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:55.365031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:55.425177 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:55.433370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5aa31e83-f5e0-408d-9707-e48215759134 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080689 Jul 19 12:52:55.433936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 541/1227] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:55.715193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:55.715802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:55.718131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:55.724133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:55.724613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:55.725379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:55.725813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:55.853533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:55.861457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-603fffff-7c92-49bf-9701-274c7dccf899 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150175 Jul 19 12:52:55.862023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 687/1228] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:55 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:56.450339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:56.450953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:56.457519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:56.457969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:56.458728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:56.459167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:56.528011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:56.535977 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c1446c21-a07c-4801-b4e0-ee64c10dccaf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090032 Jul 19 12:52:56.536583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 542/1229] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:56.879078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:56.879698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:56.886836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:56.887291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:56.888060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:56.888533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:57.013789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:57.021905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9eb7a55d-46e2-47f9-af76-ca3a2feb335b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146760 Jul 19 12:52:57.022477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 688/1230] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:56 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:57.552810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:57.553413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:57.556278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:57.561545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:57.561938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:57.562691 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:57.563126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:57.623823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:57.631635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ba645d11-23f1-4530-8f31-3478db9063eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082768 Jul 19 12:52:57.632216 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 543/1231] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:58.038865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:58.039486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:58.046158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:58.046614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:58.047385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:58.047827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:58.184553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:58.192525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c9867b6-b795-4fa2-8303-f5ff50a64971 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.157480 Jul 19 12:52:58.193302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 689/1232] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:58 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:58.648574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:58.649275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:58.655706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:58.656112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:58.656903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:58.657343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:58.717704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:58.725547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a305daef-db88-4032-86d8-eca546040fb1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080796 Jul 19 12:52:58.726109 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 544/1233] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:59.210469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:59.211085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:59.218029 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:59.218489 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:59.219239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:59.219675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:59.348797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:59.357376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eacdde37-5828-446b-a91d-b3bca3561025 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150798 Jul 19 12:52:59.357940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 690/1234] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:59 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:52:59.742952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:52:59.743623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:52:59.750126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:59.750582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:59.751355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:52:59.751798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:52:59.818468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:52:59.827740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a0fab0ea-e4f5-4315-aef5-ebef8ed8f862 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088919 Jul 19 12:52:59.828337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 545/1235] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:52:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:00.374456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:00.375120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:00.381453 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:00.381901 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:00.382655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:00.383087 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:00.512205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:00.514590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:00.521403 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0193e5bf-f8d9-4232-89f1-1b68803d3d6e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150768 Jul 19 12:53:00.521969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 691/1236] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:00 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:00.844308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:00.844905 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:00.851333 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:00.851781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:00.853302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:00.853597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:00.913539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:00.922028 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-79f03dee-968e-413e-b5ae-bf9657e93528 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081629 Jul 19 12:53:00.922584 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 546/1237] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:01.538579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:01.539159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:01.545769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:01.546216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:01.546981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:01.547416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:01.677146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:01.685563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b00cb9c-bf23-42a2-b539-3ff9b12324dc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151038 Jul 19 12:53:01.686124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 692/1238] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:01 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:01.938797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:01.939332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:01.945787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:01.946241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:01.947003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:01.947444 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:02.007657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:02.015896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-38365d5d-4849-4288-b66a-cbda2c6a95fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081085 Jul 19 12:53:02.016488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 547/1239] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:02.703228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:02.703781 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:02.710256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:02.710716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:02.711480 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:02.711919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:02.840160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:02.848815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec42791c-a66f-4204-ab50-cf92035eae11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149659 Jul 19 12:53:02.849383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 693/1240] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:02 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:03.031936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:03.032587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:03.039386 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:03.039862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:03.041316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:03.041837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:03.056446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:03.106495 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:03.114225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e516e2fc-3307-483c-a4d8-7fb83b6b3bea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086146 Jul 19 12:53:03.114781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 548/1241] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:03.866114 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:03.866662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:03.873658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:03.874104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:03.874860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:03.875292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:04.000355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:04.008135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db3d9430-be97-4350-8a9f-fef48f33983f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146134 Jul 19 12:53:04.008989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 694/1242] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:03 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:04.393221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:04.393843 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:04.400449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:04.400903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:04.401669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:04.402108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:04.462769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:04.472275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bac5cbc1-1bc5-4283-b2be-c95c599233a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.344107 Jul 19 12:53:04.472275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 549/1243] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:05.025250 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:05.026065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:05.032612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:05.033074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:05.033878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:05.034329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:05.201767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:05.211800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d078b68a-f361-441d-b900-6a3a6714b5a0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.190881 Jul 19 12:53:05.212413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 695/1244] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:05 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:05.489000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:05.489589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:05.496711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:05.497162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:05.497913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:05.498347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:05.558593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:05.567086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a7d6e2ad-90bb-4028-bf80-0d26c5dc8bff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081984 Jul 19 12:53:05.567644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 550/1245] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:06.228311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:06.228916 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:06.235313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:06.235757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:06.236544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:06.236974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:06.364986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:06.372773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab0ee3a7-c53d-4716-8d26-f54904eba34f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148344 Jul 19 12:53:06.373333 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 696/1246] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:06 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:06.583526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:06.584057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:06.590597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:06.591044 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:06.591799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:06.592285 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:06.654714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:06.662336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-33ae0828-aade-418c-a791-1a65a80adb1d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082746 Jul 19 12:53:06.662900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 551/1247] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:07.390125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:07.390740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:07.397179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:07.397629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:07.398412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:07.398825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:07.522996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:07.531351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ecbce1d-0637-4deb-9979-36a23b65182d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145381 Jul 19 12:53:07.531921 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 697/1248] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:07 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:07.678857 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:07.679412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:07.686186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:07.686645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:07.687414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:07.687856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:07.750627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:07.758523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-872102cf-2a1f-4438-a056-d39364df242f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083651 Jul 19 12:53:07.759096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 552/1249] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:08.547961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:08.548594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:08.555025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:08.555468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:08.556751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:08.557179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:08.683961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:08.691850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cae1de3e-9296-4911-9a60-c3696997a68b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147701 Jul 19 12:53:08.692442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 698/1250] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:08 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:08.775167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:08.775779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:08.782133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:08.782592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:08.783340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:08.783773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:08.843690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:08.851428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c5539810-fc6a-4405-8d81-71f666b05aa2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080054 Jul 19 12:53:08.851986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 553/1251] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:09.708613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:09.709221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:09.715590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:09.716034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:09.716818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:09.717249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:09.845385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:09.853787 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f95ad169-8a75-49fb-ad4a-189c34378653 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149005 Jul 19 12:53:09.854351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 699/1252] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:09 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:09.868884 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:09.869437 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:09.875727 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:09.876205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:09.876960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:09.877397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:09.937535 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:09.945273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b9a34ccb-c4b3-4cb9-a161-81d74299ce1c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080852 Jul 19 12:53:09.945832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 554/1253] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:10.871907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:10.872471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:10.878916 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:10.879370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:10.880128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:10.880583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:10.961996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:10.963136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:10.969641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:10.970143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:10.970910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:10.971341 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:11.007490 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:11.016342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a5f64cda-2af2-4d55-b80a-05622c2dc1e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148798 Jul 19 12:53:11.016922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 700/1254] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:10 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:11.038098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:11.046019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c3dd8e0e-58ef-4e4e-bcff-460ab760fd0c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.087945 Jul 19 12:53:11.046572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 555/1255] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:12.033343 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:12.033985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:12.041062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:12.041519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:12.042286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:12.042723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:12.062354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:12.062993 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:12.069390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:12.069841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:12.070599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:12.071035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:12.138183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:12.146370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3d8e1e8b-d720-4121-bece-7049edaf8fa7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.087818 Jul 19 12:53:12.146929 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 556/1256] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:12.194056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:12.202182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ea979e0b-b7c4-4709-91c9-cd9ccae6c6e8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.172772 Jul 19 12:53:12.202749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 701/1257] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:12 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:13.163513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:13.164120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:13.170981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:13.171431 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:13.172196 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:13.172640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:13.220476 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:13.221184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:13.228135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:13.228618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:13.229374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:13.229802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:13.236361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:13.244842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0acf1b04-7942-4ec8-9ecc-7741dc02e212 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085200 Jul 19 12:53:13.245408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 557/1258] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:13.355219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:13.362933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b1847ef-5096-4cb8-ab29-fbf60a234bb9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146370 Jul 19 12:53:13.363496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 702/1259] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:13 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:14.262804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:14.263416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:14.270133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:14.270582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:14.271338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:14.271772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:14.333444 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:14.341107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d1e55b85-10b2-4dd9-9644-ce7ada6b2cc9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083155 Jul 19 12:53:14.341679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 558/1260] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:14.379806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:14.380449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:14.387663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:14.388144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:14.388931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:14.389640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:14.518224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:14.526065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c483ac9b-edf9-4ece-8180-bac17a10a22e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150079 Jul 19 12:53:14.526629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 703/1261] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:14 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:15.358134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:15.358742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:15.365260 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:15.365740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:15.366503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:15.366970 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:15.431138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:15.443507 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f23ae707-c39f-468b-9e68-68d9e0fd2179 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089715 Jul 19 12:53:15.444083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 559/1262] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:15.543400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:15.543964 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:15.550527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:15.550973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:15.551730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:15.552162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:15.680131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:15.688075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43de1f78-f08b-48cf-9232-9898bef6dcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149026 Jul 19 12:53:15.688674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 704/1263] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:15 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:16.460072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:16.460705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:16.467562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:16.468011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:16.468806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:16.469239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:16.532062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:16.539922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cdfbba64-942a-4b9b-9909-d59d9e225716 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083704 Jul 19 12:53:16.540528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 560/1264] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:16.705231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:16.705778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:16.712164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:16.712650 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:16.714028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:16.714467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:16.840240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:16.848069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-516208ef-c3e3-42a0-a60a-26e31caf9e4f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146765 Jul 19 12:53:16.848663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 705/1265] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:16 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:17.557754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:17.558359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:17.564872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:17.565342 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:17.566077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:17.566509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:17.627258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:17.635146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-883df5b1-075a-4aa2-9ecc-a4857c8f1e27 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081892 Jul 19 12:53:17.635703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 561/1266] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:17.865071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:17.865608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:17.872258 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:17.872710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:17.873475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:17.873908 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:18.001793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:18.009689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf602290-ccdd-4f76-9b67-c994b4533314 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148499 Jul 19 12:53:18.010243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 706/1267] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:17 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:18.652055 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:18.652700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:18.659194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:18.659650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:18.660447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:18.660940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:18.721111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:18.729041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-86621b41-9796-489f-8ed9-5224f99b510b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080909 Jul 19 12:53:18.729609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 562/1268] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:19.026951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:19.027563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:19.034024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:19.034471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:19.035228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:19.035665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:19.162118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:19.170463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22e9d2fa-291f-44ff-ab26-183270f0985d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147425 Jul 19 12:53:19.171022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 707/1269] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:19 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:19.745424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:19.746254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:19.754019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:19.754474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:19.755251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:19.755694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:19.819659 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:19.828030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fb12c2c9-2786-4be7-a313-86204522ab2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086848 Jul 19 12:53:19.828798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 563/1270] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:20.187999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:20.188666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:20.195119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:20.195571 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:20.196365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:20.196805 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:20.211617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:20.323587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:20.331569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6406b501-38f2-447e-b54f-31ceb932f94d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147437 Jul 19 12:53:20.332128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 708/1271] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:20 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:20.844261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:20.844872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:20.851298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:20.851748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:20.852542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:20.852975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:20.915466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:20.923188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f5dfd69a-d5d7-422c-bdf8-b7158989fa67 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082983 Jul 19 12:53:20.923746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 564/1272] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:21.348785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:21.349424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:21.356405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:21.356857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:21.357629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:21.358046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:21.639954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:21.647725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-17163782-495b-40e5-a884-6e7049592f8e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.302794 Jul 19 12:53:21.648325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 709/1273] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:21 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:21.940272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:21.940805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:21.947828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:21.948313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:21.949085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:21.949525 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:21.953534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:22.011355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:22.019481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7775dd23-4748-44b7-96cc-367c0eac9ae1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083113 Jul 19 12:53:22.020046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 565/1274] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:22.665351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:22.665931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:22.672397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:22.672848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:22.673621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:22.674054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:22.798277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:22.806111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4181ab06-fd2f-4f5d-92e7-4d8c0791bcd0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.144692 Jul 19 12:53:22.807232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 710/1275] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:22 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:23.036933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:23.037594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:23.044595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:23.045053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:23.045816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:23.046252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:23.110602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:23.118397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e6deafe6-d3fe-475b-99b5-e9732664302b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085329 Jul 19 12:53:23.118983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 566/1276] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:23.823840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:23.824746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:23.831859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:23.832350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:23.833125 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:23.833565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:23.960170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:23.968603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8c4712d5-ed10-45a4-acbe-eb030216926a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148740 Jul 19 12:53:23.969174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 711/1277] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:23 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:24.134877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:24.135515 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:24.142128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:24.142579 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:24.143332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:24.143764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:24.204054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:24.211873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7867d3c5-6cdb-4385-bee3-09baab6b0c99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080789 Jul 19 12:53:24.212467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 567/1278] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:24.985219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:24.985864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:24.991881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:24.992358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:24.993113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:24.993543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:25.118477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:25.126205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-671775ff-1623-4627-9963-c7ea2f98cd25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.144947 Jul 19 12:53:25.126759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 712/1279] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:24 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:25.229384 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:25.229991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:25.236124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:25.236553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:25.237306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:25.237740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:25.297469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:25.305231 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-aa6713e0-570c-40e6-bd7c-e975e355d687 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080148 Jul 19 12:53:25.305793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 568/1280] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:26.142964 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:26.143565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:26.145977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=52 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:26.151364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:26.151820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:26.152618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:26.153055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:26.278540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:26.286389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36d33675-a412-4f3e-90f6-5b3d3b339dab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147522 Jul 19 12:53:26.286959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 713/1281] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:26 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:26.323610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:26.324230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:26.330710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:26.331159 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:26.331917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:26.332378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:26.395513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:26.403628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1712a6a1-5531-4341-95dd-2c8125f56157 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084320 Jul 19 12:53:26.404270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 569/1282] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:27.303629 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:27.304257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:27.310805 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:27.311250 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:27.312002 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:27.312455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:27.420501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:27.421141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:27.427295 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:27.427753 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:27.428548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:27.428990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:27.441385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:27.449631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab5e73e9-9585-460d-9bd7-c1e8c9ce5f11 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149857 Jul 19 12:53:27.450194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 714/1283] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:27 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:27.490524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:27.498426 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-551528c8-d595-413a-98df-0f6742dd8971 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081828 Jul 19 12:53:27.498992 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 570/1284] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:28.369667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:53:28.370253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:53:28.466740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:28.467353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:28.473836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:28.474289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:28.475055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:28.475493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:28.514906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:28.515526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:28.518006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:28.523376 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:28.523831 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:28.524640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:28.525585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:28.601807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:28.615205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a6ba6968-8c6c-437c-b8a7-7cf79b667366 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.103745 Jul 19 12:53:28.615579 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 571/1285] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:28.631836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:28.641886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-26127387-7107-43fd-b5b1-0aa10f8ff271 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.179386 Jul 19 12:53:28.642449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 715/1286] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:28 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:29.630759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:29.631371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:29.637904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:29.638349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:29.639102 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:29.639789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:29.659940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:29.660588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:29.667553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:29.668005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:29.668809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:29.669249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:29.704155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:29.712162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-04181195-7f65-40fb-925a-534aef8a7b4d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085219 Jul 19 12:53:29.712906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 572/1287] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:29.799244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:29.807772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6406e4e7-cfa1-4d45-bb24-1558b6131d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151657 Jul 19 12:53:29.808376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 716/1288] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:29 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:30.730451 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:30.731070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:30.737674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:30.738126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:30.738902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:30.739343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:30.803821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:30.811916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-455e6449-19ef-4495-b11a-71b0d0581f21 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085976 Jul 19 12:53:30.812522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 573/1289] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:30.824600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:30.825269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:30.831722 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:30.832261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:30.833024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:30.833459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:30.964015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:30.971815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a0813a04-bfe8-4fe6-aa7a-e9827a0d697e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151003 Jul 19 12:53:30.972406 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 717/1290] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:30 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:31.828829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:31.829452 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:31.835878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:31.836359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:31.837165 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:31.838141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:31.897771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:31.906538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d005b412-4049-498a-ab58-4701fbdbb755 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081544 Jul 19 12:53:31.907106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 574/1291] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:31.988562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:31.989180 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:31.995584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:31.996035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:31.996833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:31.997266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:32.130074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:32.138467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc670c53-020e-456d-8425-6e2d2bf3ef51 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.153721 Jul 19 12:53:32.139017 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 718/1292] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:31 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:32.923005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:32.923620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:32.930182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:32.930637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:32.931395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:32.931839 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:32.991817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:32.999722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ca35946f-2eb5-4d8b-ae10-a013d8b47548 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080572 Jul 19 12:53:33.000316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 575/1293] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:33.155938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:33.156577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:33.163088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:33.163539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:33.164349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:33.164791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:33.291100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:33.299168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f10347b-bf8b-439e-96b2-9c11f1d3ce1a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146938 Jul 19 12:53:33.299926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 719/1294] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:33 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:34.016612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:34.017234 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:34.023628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:34.024088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:34.024953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:34.025394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:34.088100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:34.095962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-791100c5-cedd-48c5-9174-fcac7155cb5b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083545 Jul 19 12:53:34.096561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 576/1295] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:34.316876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:34.317404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:34.323820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:34.324303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:34.325068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:34.325504 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:34.450720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:34.458531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-20fb0bb4-ce39-4dad-9d0b-efb3c15e8840 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145561 Jul 19 12:53:34.459096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 720/1296] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:34 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:35.112440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:35.113096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:35.119561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:35.120551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:35.121321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:35.121764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:35.181198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:35.189615 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-76f29612-3479-4042-809b-048bd7fc712c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081084 Jul 19 12:53:35.190184 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 577/1297] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:35.291757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:53:35.291920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:53:35.475874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:35.476528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:35.483473 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:35.483924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:35.484721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:35.485157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:35.613108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:35.621732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-042e6601-6ba2-4b45-9535-7fc85082e184 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149723 Jul 19 12:53:35.622295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 721/1298] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:35 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:36.206849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:36.207489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:36.214016 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:36.214467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:36.215226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:36.215670 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:36.277544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:36.285336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d16588f5-a06e-4068-ae52-b831e2f64ad9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082331 Jul 19 12:53:36.285902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 578/1299] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:36.639256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:36.640134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:36.646740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:36.647193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:36.647959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:36.648431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:36.775936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:36.783815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aab0d0b7-21bc-4ec4-9728-860f54be2188 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149031 Jul 19 12:53:36.784407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 722/1300] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:36 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:37.301825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:37.302445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:37.309070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:37.309527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:37.310287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:37.310726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:37.374040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:37.381961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0fc53ea0-7fb5-4909-8313-aec17c39d5dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084015 Jul 19 12:53:37.382517 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 579/1301] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:37.800383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:37.801021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:37.808019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:37.808495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:37.809259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:37.809693 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:37.937757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:37.945573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cae5a056-f3e5-48d3-93e8-4c0f408cbfa4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149035 Jul 19 12:53:37.946133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 723/1302] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:37 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:38.398703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:38.399338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:38.405759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:38.406221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:38.406962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:38.407395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:38.467233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:38.474952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6fa80f49-65c8-44cc-b329-60bfc719fea6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080096 Jul 19 12:53:38.475509 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 580/1303] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:38.962516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:38.963133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:38.970073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:38.970525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:38.971287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:38.971726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:39.102293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:39.110712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bba4efd1-d498-4b13-8191-c06ddddb5ab1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152073 Jul 19 12:53:39.111270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 724/1304] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:38 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:39.492030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:39.492702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:39.499492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:39.499951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:39.500764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:39.501207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:39.561387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:39.563508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:39.570557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-07ce8130-af0a-4edb-aff0-2ea6b7f553a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082346 Jul 19 12:53:39.571121 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 581/1305] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:40.127570 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:40.128213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:40.134633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:40.135090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:40.136377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:40.136815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:40.140948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:40.260815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:40.268904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa93416a-fd02-4874-9f3c-27af4d055fba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145147 Jul 19 12:53:40.269463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 725/1306] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:40 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:40.587194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:40.587808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:40.594289 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:40.594745 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:40.595515 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:40.595954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:40.658964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:40.667306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-94e5bff1-4170-4ac8-84c0-e403b72ce199 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083420 Jul 19 12:53:40.667871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 582/1307] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:41.286535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:41.287148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:41.294247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:41.294698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:41.295467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:41.295906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:41.419775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:41.427687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-387f19eb-ce86-4745-9a50-4af086669362 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145023 Jul 19 12:53:41.428274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 726/1308] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:41 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:41.684346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:41.684962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:41.691328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:41.691776 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:41.692563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:41.693002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:41.753441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:41.761263 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fd50e410-8bc3-4d7f-9d3b-bfb4a54e25b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081456 Jul 19 12:53:41.761920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 583/1309] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:42.444697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:42.445311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:42.451906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:42.452407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:42.453179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:42.453632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:42.581302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:42.589646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eaa2063f-59c4-45c9-9f2d-eba3d8414ec3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148857 Jul 19 12:53:42.590204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 727/1310] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:42 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:42.778736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:42.779352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:42.785881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:42.786336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:42.787100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:42.787541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:42.849296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:42.857794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ab38a611-d751-4966-a381-c952d0ca37e4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083434 Jul 19 12:53:42.858365 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 584/1311] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:43.606708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:43.607326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:43.613936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:43.614394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:43.615171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:43.615612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:43.741578 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:43.749984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f402d46a-6af9-47d6-90c5-5e2c3ad5b7cd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147225 Jul 19 12:53:43.750546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 728/1312] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:43 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:43.875015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:43.875560 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:43.881641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:43.882098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:43.882858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:43.883299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:43.946939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:43.954900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a8f0c1dc-905b-410b-bd53-f38a824eb982 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083758 Jul 19 12:53:43.955460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 585/1313] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:44.767713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:44.768350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:44.774782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:44.775235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:44.776712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:44.777151 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:44.903380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:44.911253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a597a678-de9d-4334-a7e4-ee15b624cee0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147623 Jul 19 12:53:44.911815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 729/1314] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:44 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:44.971926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:44.972571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:44.978989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:44.979427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:44.980198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:44.980655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:45.040640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:45.048566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e03f2f6f-bd28-4815-9f36-724a1be579cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080446 Jul 19 12:53:45.049133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 586/1315] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:45.928241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:45.928839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:45.935172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:45.935614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:45.936397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:45.936832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:46.066016 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:46.066745 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:46.072164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:46.073951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:46.074406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:46.075183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:46.075622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:46.080601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07018972-f5f9-4a0a-a6f3-6a8504ddc266 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.156170 Jul 19 12:53:46.081172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 730/1316] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:45 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:46.136314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:46.144274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-934d050a-5cb1-41e5-ac76-4ddef51e843b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082121 Jul 19 12:53:46.144835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 587/1317] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:47.097829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:47.098451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:47.105666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:47.106124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:47.106893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:47.107342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:47.161609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:47.162256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:47.169318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:47.169771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:47.170538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:47.170975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:47.239200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:47.247103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-28f45516-51c2-4223-84b8-bf46203ecaf1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089367 Jul 19 12:53:47.247731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 588/1318] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:47.259948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:47.268035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e62eddcd-f0cd-4cfe-8d41-d9f7ccb77f67 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.174078 Jul 19 12:53:47.268623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 731/1319] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:47 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:48.263853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:48.264493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:48.271835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:48.272313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:48.273076 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:48.273528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:48.285984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:48.286618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:48.293434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:48.293891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:48.294648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:48.295085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:48.569146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:48.577539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cab247d1-09ef-4436-b335-36ff1dffccf7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.317541 Jul 19 12:53:48.578115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 589/1320] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:48.660202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:48.668769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-958cc647-e8a2-44bd-acae-cb777c314d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.386608 Jul 19 12:53:48.669354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 732/1321] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:48 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:49.593870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:49.594479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:49.600957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:49.601406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:49.602161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:49.602594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:49.665544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:49.673222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f5f6ff31-17d3-43dd-ac14-2a43219dad2d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083159 Jul 19 12:53:49.673778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 590/1322] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:49.685934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:49.686547 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:49.693762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:49.694219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:49.694983 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:49.695420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:49.824291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:49.832508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d7d72595-4ca3-4248-a3c2-671158fcdcef tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150706 Jul 19 12:53:49.833072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 733/1323] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:49 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:50.689187 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:50.689734 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:50.696170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:50.696647 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:50.697402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:50.697837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:50.757265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:50.765678 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-799cfe57-60aa-4183-834c-831ec51f36ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080360 Jul 19 12:53:50.766242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 591/1324] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:50.849068 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:50.849701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:50.856672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:50.857120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:50.857876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:50.858310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:50.983355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:50.991142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c002d3c5-b238-4452-a044-7aee65938dc2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145919 Jul 19 12:53:50.991706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 734/1325] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:50 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:51.782183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:51.782794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:51.789282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:51.789730 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:51.790487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:51.790919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:51.854210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:51.862004 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e2b24fa7-59f0-45f8-8867-305b9187243f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083686 Jul 19 12:53:51.862556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 592/1326] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:52.008069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:52.008716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:52.015466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:52.015917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:52.016715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:52.017156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:52.143057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:52.150864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-627e2159-bd78-42f5-854e-afd21e76555d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146716 Jul 19 12:53:52.151428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 735/1327] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:52 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:53:52.878988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:52.879593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:52.886458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:52.886900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:52.887651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:52.888086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:52.948006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:52.955722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-94431256-3311-4aa5-81d1-f9352c286045 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080593 Jul 19 12:53:52.956302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 593/1328] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:53.167065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:53.167605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:53.174022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:53.174468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:53.175229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:53.175664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:53.301644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:53.309837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-33f52f01-784a-4792-9660-ab4ae8d6e46d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146663 Jul 19 12:53:53.310397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 736/1329] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:53 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:53.973101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:53.973651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:53.979989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:53.980472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:53.981240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:53.981678 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:54.042549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:54.050421 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4e932d78-a90d-49b5-b8c4-2f5b7afae2cc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081216 Jul 19 12:53:54.050981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 594/1330] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:54.326469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:54.327083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:54.333912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:54.334364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:54.335127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:54.335566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:54.464796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:54.472544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-35dc4843-0a36-4d61-b6f9-8afb74b46de8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149910 Jul 19 12:53:54.473107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 737/1331] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:54 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:55.067791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:55.068481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:55.074953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:55.075400 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:55.076154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:55.076610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:55.138559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:55.146603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b9a4aa6d-6c6f-4609-b3cd-c2a46dc1f5ec tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082823 Jul 19 12:53:55.147157 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 595/1332] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:55.489534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:55.490174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:55.496758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:55.497211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:55.497968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:55.498406 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:55.625472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:55.633273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-14a2f6f9-523a-4ce1-ba43-b5fc8981b0f7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147720 Jul 19 12:53:55.633832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 738/1333] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:55 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:56.163193 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:56.163809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:56.170375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:56.170783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:56.171552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:56.171990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:56.232216 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:56.240084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-152dbe1c-49bd-4fa3-b9cd-eca3b7a16d8d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080703 Jul 19 12:53:56.240618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 596/1334] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:56.651825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:56.652486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:56.654770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=52 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:56.660244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:56.660702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:56.661465 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:56.661904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:56.793619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:56.801479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-467c3fe7-2b15-4cf1-8342-bb63852615a7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.154039 Jul 19 12:53:56.802037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 739/1335] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:56 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:57.257097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:57.257708 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:57.264624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:57.265337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:57.266090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:57.266523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:57.328634 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:57.336371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9bc31d3e-c895-4759-b183-ec339fce3718 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083072 Jul 19 12:53:57.336943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 597/1336] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:57.818569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:57.819184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:57.826355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:57.826816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:57.827580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:57.828019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:57.952357 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:57.960302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-505b3403-96ff-4c45-8625-2defa6562807 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145507 Jul 19 12:53:57.960866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 740/1337] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:57 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:58.353314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:58.355090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:58.361605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:58.362059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:58.362821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:58.363262 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:58.379567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:58.429809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:58.437700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5546b9ac-f89f-4a41-8e09-5af2f06bc149 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088195 Jul 19 12:53:58.438259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 598/1338] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:58.976513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:58.977134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:58.983536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:58.983988 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:58.984780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:58.985215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:59.110922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:59.113107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:59.121344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2fdd1901-31b6-432d-8f41-839608fb3fe4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148666 Jul 19 12:53:59.121910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 741/1339] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:58 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:53:59.454521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:53:59.455058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:53:59.457382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:53:59.462685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:59.463192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:59.463983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:53:59.464445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:53:59.524493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:53:59.532298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4559fd7b-f07d-4c88-b879-de284f1374e5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081684 Jul 19 12:53:59.532860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 599/1340] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:53:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:00.139304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:00.140105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:00.146555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:00.147010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:00.147774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:00.148235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:00.274529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:00.282675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-21d1d2ca-9049-4fad-933f-b37b01f07700 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148160 Jul 19 12:54:00.283243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 742/1341] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:00 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:00.549408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:00.550018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:00.556527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:00.557020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:00.557807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:00.558241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:00.618499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:00.626574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a1feab4c-b04a-4021-8faa-0319d1165130 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081006 Jul 19 12:54:00.627128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 600/1342] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:01.300108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:01.300776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:01.308223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:01.308678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:01.309449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:01.309883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:01.437454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:01.445356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78569ad4-c714-45b8-91cb-38f9ae22351c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149118 Jul 19 12:54:01.445936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 743/1343] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:01 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:01.643410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:01.644054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:01.650567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:01.651023 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:01.651793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:01.652271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:01.715814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:01.723759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3d7408ff-c968-4a0d-a3d3-62496175f5c8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084495 Jul 19 12:54:01.724347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 601/1344] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:02.462780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:02.463335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:02.470439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:02.470886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:02.471643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:02.472075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:02.598644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:02.606532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77e05ec4-8936-469b-90c4-257ad1784656 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147592 Jul 19 12:54:02.607152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 744/1345] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:02 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:02.740941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:02.741560 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:02.748533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:02.748988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:02.749749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:02.750186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:02.810430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:02.818168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c787c0dc-aa93-45a6-b8de-67a668a994c3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081105 Jul 19 12:54:02.818737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 602/1346] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:03.622874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:03.623493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:03.630009 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:03.630463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:03.631224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:03.631664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:03.759824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:03.767934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7302f22c-db74-4c80-9b68-8db80365f8bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148991 Jul 19 12:54:03.768527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 745/1347] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:03 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:03.835746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:03.836392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:03.843176 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:03.843624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:03.844671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:03.845112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:03.907766 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:03.915478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-86d53358-ddfc-4274-a2db-8c609b1cdd75 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083544 Jul 19 12:54:03.916046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 603/1348] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:04.785642 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:04.786251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:04.793215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:04.793667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:04.794432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:04.794868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:04.919043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:04.926827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8cdcb19d-7a83-457e-8e1e-34ae11ddc4c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145095 Jul 19 12:54:04.927493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 746/1349] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:04 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:04.932127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:04.933316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:04.939623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:04.940072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:04.940866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:04.941302 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:05.005447 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:05.014154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-776dce4f-99e9-49fa-8832-1c8cc59c8d17 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085724 Jul 19 12:54:05.014981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 604/1350] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:05.944635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:05.945172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:05.952155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:05.952631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:05.953393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:05.953829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:06.030987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:06.031656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:06.038530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:06.038979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:06.039739 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:06.040200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:06.090595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:06.098608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d068e559-01a2-4185-b084-3d5964af1cbb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.157897 Jul 19 12:54:06.099286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 747/1351] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:05 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:06.106190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:06.114068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ed1c7685-770f-4e1b-adbe-84145dd672dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.087103 Jul 19 12:54:06.114620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 605/1352] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:07.116445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:07.117052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:07.123796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:07.124286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:07.125046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:07.125477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:07.130651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:07.131267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:07.138086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:07.138540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:07.139310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:07.139995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:07.221921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:07.229749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-64d09f08-aba2-4f98-8c3c-8544ca36250e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.102943 Jul 19 12:54:07.230377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 606/1353] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:07.283092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:07.290914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9211efcd-6d31-49a3-bf90-892c55ce586e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.178612 Jul 19 12:54:07.291476 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 748/1354] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:07 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:08.246406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:08.247020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:08.253697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:08.254153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:08.254958 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:08.255404 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:08.306734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:08.307342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:08.313899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:08.314854 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:08.315105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:08.315545 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:08.316898 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:08.324804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9e49647e-da00-4662-947d-d086c6b396a0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082282 Jul 19 12:54:08.325384 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 607/1355] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:08.449645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:08.457499 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-efe2bee6-d55a-437c-a828-1c87bd5169a3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.154565 Jul 19 12:54:08.458054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 749/1356] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:08 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:09.341873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:09.342492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:09.348908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:09.349359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:09.350120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:09.350558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:09.411571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:09.419889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8b70eab1-ca7e-456b-810f-309e48b26a0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081986 Jul 19 12:54:09.420658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 608/1357] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:09.474595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:09.475211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:09.482090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:09.482540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:09.483292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:09.483726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:09.612623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:09.619366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a5e050bd-8a37-4d91-a6c7-63ced67cd454 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148560 Jul 19 12:54:09.619926 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 750/1358] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:09 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:10.436311 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:10.436919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:10.443315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:10.443772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:10.444640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:10.445083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:10.508909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:10.517704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4212aa24-706d-4327-8ed6-e40516d33a1f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085797 Jul 19 12:54:10.518272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 609/1359] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:10.636850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:10.637498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:10.644277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:10.644738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:10.645505 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:10.645945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:10.771137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:10.778975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-55da86bd-abc4-4aa4-86a8-eb081dffe41e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146650 Jul 19 12:54:10.779541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 751/1360] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:10 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:11.534482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:11.535105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:11.541766 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:11.542223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:11.542995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:11.543441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:11.605436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:11.613792 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c9fbc7b8-c3d3-44ff-80a5-7f762eaef0b5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083180 Jul 19 12:54:11.614365 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 610/1361] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:11.795992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:11.796641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:11.803133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:11.803578 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:11.804365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:11.804799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:11.934726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:11.942551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-14a82937-d57e-4833-874c-65f8fd657ad7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150456 Jul 19 12:54:11.943108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 752/1362] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:11 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:12.630104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:12.630715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:12.637400 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:12.637849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:12.638606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:12.639039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:12.700912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:12.709475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d94f59ba-b12d-41b7-89d0-1a06f3bff0ee tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083162 Jul 19 12:54:12.710039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 611/1363] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:12.960329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:12.960869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:12.967950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:12.968467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:12.969231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:12.969667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:13.102164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:13.109979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b5c37b1-3cc1-44e9-b618-efb4b1a45b19 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.153586 Jul 19 12:54:13.110544 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 753/1364] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:12 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:13.726632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:13.727255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:13.734320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:13.734774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:13.735537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:13.735984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:13.803289 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:13.811872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-01396acb-09b6-4510-965e-57acfae642f3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089410 Jul 19 12:54:13.812502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 612/1365] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:14.126728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:14.127330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:14.133815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:14.134240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:14.134995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:14.135428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:14.260221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:14.268568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b260c36e-445e-4fe0-810b-b0c956f82fcc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145621 Jul 19 12:54:14.269132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 754/1366] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:14 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:14.829024 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:14.830754 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:14.836049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:14.836533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:14.837284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:14.837718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:14.897705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:14.905527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c975e619-8bab-4bed-892c-309a44439a06 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080357 Jul 19 12:54:14.906087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 613/1367] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:15.286036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:15.286648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:15.293652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:15.294103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:15.294868 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:15.295305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:15.431502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:15.439959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7bf0141f-0889-4dc7-8476-303586929c9c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.157821 Jul 19 12:54:15.440559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 755/1368] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:15 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:15.922023 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:15.922557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:15.929009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:15.929469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:15.930233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:15.930673 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:15.991245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:15.999200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b6c826a4-7019-4b25-ac3b-aea940ac37bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081069 Jul 19 12:54:15.999771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 614/1369] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:16.457135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:16.457748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:16.464302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:16.464756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:16.465523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:16.465959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:16.591077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:16.598886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ca5c08a-2fe1-4d65-8b2a-30d85c731ae4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145720 Jul 19 12:54:16.599457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 756/1370] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:16 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:17.016604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:17.017226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:17.023819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:17.024306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:17.025080 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:17.025525 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:17.030036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:17.090180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:17.097980 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5be91229-e435-44bb-b53d-f6cb47e1bb73 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085637 Jul 19 12:54:17.098576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 615/1371] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:17.615905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:17.616571 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:17.622984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:17.623433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:17.624215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:17.624654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:17.752699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:17.761269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a5eb7de0-0a70-4932-a427-563bad484b90 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148518 Jul 19 12:54:17.761838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 757/1372] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:17 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:18.115170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:18.115779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:18.122669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:18.123117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:18.123871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:18.124334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:18.187536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:18.195390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-85a72f6b-ba38-4e31-b122-2ee839411db2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084106 Jul 19 12:54:18.195954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 616/1373] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:18.778594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:18.779203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:18.785671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:18.786118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:18.786875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:18.787306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:18.802391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:18.916118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:18.923889 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-295c89f6-75e3-40b9-af0a-70e64cda6968 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149635 Jul 19 12:54:18.924501 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 758/1374] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:18 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:19.211877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:19.212438 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:19.219364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:19.219815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:19.220602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:19.221033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:19.280856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:19.288603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-62a382eb-630b-4c46-89dd-c194287ec503 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080569 Jul 19 12:54:19.289163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 617/1375] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:19.940946 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:19.941514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:19.947881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:19.948374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:19.949130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:19.949566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:20.074061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:20.081810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1dfa5aa5-b9f3-4892-a282-497d42902a33 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.144801 Jul 19 12:54:20.082366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 759/1376] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:19 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:20.305018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:20.305650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:20.312106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:20.312582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:20.313337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:20.313768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:20.377621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:20.385968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-590223be-c9cc-4c22-8152-eee68e126d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084256 Jul 19 12:54:20.386530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 618/1377] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:21.099146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:21.099759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:21.106175 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:21.106619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:21.107372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:21.107802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:21.232947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:21.240707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-833a985a-e878-4064-80d5-8af04d410646 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145381 Jul 19 12:54:21.241266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 760/1378] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:21 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:21.402751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:21.403328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:21.409788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:21.410239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:21.410997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:21.411435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:21.471798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:21.480316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1106b7c0-8d87-4f0d-85a0-4d9d828db3d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081429 Jul 19 12:54:21.480923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 619/1379] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:22.258204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:22.258815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:22.266034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:22.266484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:22.267245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:22.267678 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:22.396424 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:22.404236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e3309f68-4abc-4b1e-ab1f-481cc75eee37 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149922 Jul 19 12:54:22.404800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 761/1380] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:22 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:22.497862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:22.498477 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:22.505113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:22.505564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:22.506329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:22.506767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:22.567077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:22.575592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d4972d17-2cae-4dd2-b5e8-6c27d8af0fe4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082131 Jul 19 12:54:22.576155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 620/1381] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:23.421297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:23.421902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:23.428350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:23.428799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:23.429549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:23.429979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:23.554942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:23.562845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4363eeb-f984-42ee-909b-152b98bc6912 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145415 Jul 19 12:54:23.563397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 762/1382] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:23 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:23.592570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:23.593182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:23.599533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:23.599983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:23.600773 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:23.601237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:23.666238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:23.674337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b3b70d44-6a0b-4128-9373-aeee661d3282 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086078 Jul 19 12:54:23.674853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 621/1383] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:24.579638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:24.580264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:24.586635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:24.587080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:24.587861 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:24.588864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:24.690870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:24.691590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:24.697913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:24.698312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:24.699103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:24.699533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:24.718709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:24.726622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ecbd4b4-fcde-44dc-bbc6-06c2fb9e84ff tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150759 Jul 19 12:54:24.727180 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 763/1384] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:24 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:24.761479 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:24.769597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3a488dbf-52f4-4887-bd8b-db5c1aedff2e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082639 Jul 19 12:54:24.770175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 622/1385] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:25.268279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:25.268848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:25.274888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.275410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.276319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.276757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.300730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:54:25.375448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-852a6b9d-b62d-4e0d-8ffc-c812798ab805 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 204 len: 0 microversion: 2.1 time: 0.110828 Jul 19 12:54:25.376203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 764/1386] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:54:25 2022] DELETE /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:54:25.385967 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:25.386591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:25.392821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.393279 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.394047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.394491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.523871 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:25.531361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-afb5a67a-51ef-4584-92dd-79300b23cef8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1507 microversion: 2.1 time: 0.150103 Jul 19 12:54:25.531933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 623/1387] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:25 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:25.745892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:25.746598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:25.752974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.753426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.754190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.754655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.785720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:25.786332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:25.793324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.793782 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.794540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:25.794974 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:25.872267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:25.880117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1a39ea1d-4a19-494a-b424-e73bb1395c88 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.098186 Jul 19 12:54:25.880732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 624/1388] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:25.900643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:25.908666 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-44cd3a3d-caf9-4435-bc35-97b1e5eecdc5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.167536 Jul 19 12:54:25.909243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 765/1389] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:25 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:26.363886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-3113c3a8-6c33-4066-a0b6-930dfcdf23ce req-560d0b48-4877-4f3a-ad6e-48fd781de809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773f09f7-2519-4ec4-afe6-2b0d34cb914a", "name": "network-vif-deleted", "tag": "f904e264-8882-4dee-af97-b2601553dbb4"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:54:26.373053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-3113c3a8-6c33-4066-a0b6-930dfcdf23ce req-560d0b48-4877-4f3a-ad6e-48fd781de809 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.373737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-3113c3a8-6c33-4066-a0b6-930dfcdf23ce req-560d0b48-4877-4f3a-ad6e-48fd781de809 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.387465 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-3113c3a8-6c33-4066-a0b6-930dfcdf23ce req-560d0b48-4877-4f3a-ad6e-48fd781de809 service nova] Creating event network-vif-deleted:f904e264-8882-4dee-af97-b2601553dbb4 for instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a on hv-cinder-82099 Jul 19 12:54:26.393785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-3113c3a8-6c33-4066-a0b6-930dfcdf23ce req-560d0b48-4877-4f3a-ad6e-48fd781de809 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034821 Jul 19 12:54:26.394383 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 625/1390] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:54:26.548219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:26.548969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:26.555139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.555672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.556560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.557070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.587843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.589066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.589529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lazy-loading 'fault' on Instance uuid 773f09f7-2519-4ec4-afe6-2b0d34cb914a {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:54:26.631466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:26.640495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df573b32-c966-4815-b973-0ab96f40be3d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 200 len: 1311 microversion: 2.1 time: 0.095868 Jul 19 12:54:26.641270 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 766/1391] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:26 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:26.898086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:26.898688 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:26.905094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.905543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.906335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.906767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.926358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:26.926998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:26.929563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:26.936657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.937113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.937897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:26.938333 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:26.970732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:26.979710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6bfd599c-fa19-4d36-88d8-130d8eac92dd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086303 Jul 19 12:54:26.980322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 626/1392] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:27.087559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:27.098630 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0afe35f-2dc3-4add-8bb1-142b2ed61409 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.175990 Jul 19 12:54:27.099246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 767/1393] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:26 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:27.657339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:27.658085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 773f09f7-2519-4ec4-afe6-2b0d34cb914a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:27.664171 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:27.664641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:27.665408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:27.665853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:27.679870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] HTTP exception thrown: Instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a could not be found. Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Request method failure captured: Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a HTTP/1.1 Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qQOxsCk87izCeam6W8Y9KH8-hgnipPqGe_jLWuW7RWKjvkAqy-GskVE1KyYrSq8MmheGg4ODGWfp1Wp3HljkBwqH80TSvp7-jBt6wU1dIkqzIS9MdgICP6HPLe5J8XY1hpl-aNPxZFQzIKXwdGlFh1IpWvzSXgBi5-x0SdtFSMrmtM Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:54:27.681553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12a3207b8cea465d8d1ed5c9e3963a4f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 62766e7afd01401293df7e08707d6d95 Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a could not be found. Jul 19 12:54:27.683059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '773f09f7-2519-4ec4-afe6-2b0d34cb914a'} Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a could not be found. Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:54:27.683838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a could not be found. Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a could not be found. Jul 19 12:54:27.685539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:54:27.687322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Returning 404 to user: Instance 773f09f7-2519-4ec4-afe6-2b0d34cb914a could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:54:27.687322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6054fc5d-1610-4f13-b57b-b6b7ea73303c tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a" status: 404 len: 111 microversion: 2.1 time: 0.029488 Jul 19 12:54:27.687322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 627/1394] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:27 2022] GET /compute/v2.1/servers/773f09f7-2519-4ec4-afe6-2b0d34cb914a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:54:27.692667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:27.693162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:27.699495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:27.700341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:27.701191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:27.701635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:27.731962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:54:27.810872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc1a4ed2-b48e-4ca3-a4a6-669ce8d3e8b8 tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 204 len: 0 microversion: 2.1 time: 0.121661 Jul 19 12:54:27.811840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 768/1395] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:54:27 2022] DELETE /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:54:27.821045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:27.821947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:27.828224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:27.828889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:27.829659 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:27.830097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:27.996397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:27.997046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:28.007819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:28.008295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:28.009081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:28.009519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:28.051542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:28.059087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e295cf1d-2af0-4eff-bd8b-74028f6d99bd tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1521 microversion: 2.1 time: 0.243046 Jul 19 12:54:28.059668 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 628/1396] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:27 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:28.090249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:28.098746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-998aa385-a266-4ac8-ae92-fbfa3320a1bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.106673 Jul 19 12:54:28.099875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 769/1397] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:28.116714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:28.117333 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:28.123270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:28.123734 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:28.124530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:28.124970 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:28.315133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:28.323513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c36c5df7-0ee9-4670-9927-c18fd1fe1029 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.210062 Jul 19 12:54:28.324080 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 629/1398] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:28 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:28.701800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-6fe281ab-5935-458e-904a-af6dc5483b7f req-7ddfb8e2-bbf8-48d2-8a94-47446214ab11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b29d50-f252-4413-b2aa-cdfcca1abd76", "name": "network-vif-deleted", "tag": "c3e836ab-cbed-468f-9956-ee3ffb130306"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:54:28.713732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-6fe281ab-5935-458e-904a-af6dc5483b7f req-7ddfb8e2-bbf8-48d2-8a94-47446214ab11 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:28.714268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-6fe281ab-5935-458e-904a-af6dc5483b7f req-7ddfb8e2-bbf8-48d2-8a94-47446214ab11 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:28.730470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-6fe281ab-5935-458e-904a-af6dc5483b7f req-7ddfb8e2-bbf8-48d2-8a94-47446214ab11 service nova] Creating event network-vif-deleted:c3e836ab-cbed-468f-9956-ee3ffb130306 for instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 on hv-cinder-82099 Jul 19 12:54:28.735374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-6fe281ab-5935-458e-904a-af6dc5483b7f req-7ddfb8e2-bbf8-48d2-8a94-47446214ab11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039640 Jul 19 12:54:28.735960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 770/1399] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:54:29.076022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:29.076791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:29.083554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:29.084119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:29.085005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:29.085521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:29.115367 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:29.116075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:29.118258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:29.118711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:29.119162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lazy-loading 'fault' on Instance uuid 91b29d50-f252-4413-b2aa-cdfcca1abd76 {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 12:54:29.123276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:29.123734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:29.124537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:29.125010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:29.160722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766e7afd01401293df7e08707d6d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a3207b8cea465d8d1ed5c9e3963a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:29.169629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7119dfd2-10d2-4d51-8c0f-abc5286b828d tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 200 len: 1312 microversion: 2.1 time: 0.096692 Jul 19 12:54:29.169629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 630/1400] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:29 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:29.189163 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:29.197152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5330db44-86f0-4d32-93cb-0a27a9ddedba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086060 Jul 19 12:54:29.198345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 771/1401] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:29.340856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:29.341473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:29.347354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:29.348021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:29.348824 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:29.349261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:29.477696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:29.486216 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6eb368a8-d6da-4072-8a45-97a25b943315 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149419 Jul 19 12:54:29.486695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 631/1402] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:29 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:30.185349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:30.185977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] [instance: 91b29d50-f252-4413-b2aa-cdfcca1abd76] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:30.192444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:30.192876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:30.193632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:30.194064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:30.196680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:30.209408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] HTTP exception thrown: Instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 could not be found. Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Request method failure captured: Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 HTTP/1.1 Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qQOxsCk87izCeam6W8Y9KH8-hgnipPqGe_jLWuW7RWKjvkAqy-GskVE1KyYrSq8MmheGg4ODGWfp1Wp3HljkBwqH80TSvp7-jBt6wU1dIkqzIS9MdgICP6HPLe5J8XY1hpl-aNPxZFQzIKXwdGlFh1IpWvzSXgBi5-x0SdtFSMrmtM Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 12:54:30.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12a3207b8cea465d8d1ed5c9e3963a4f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12a3207b8cea465d8d1ed5c9e3963a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 12a3207b8cea465d8d1ed5c9e3963a4f Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1866945952 Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 62766e7afd01401293df7e08707d6d95 Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1866945952-project Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 could not be found. Jul 19 12:54:30.212860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '91b29d50-f252-4413-b2aa-cdfcca1abd76'} Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 could not be found. Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:54:30.214269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 could not be found. Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 could not be found. Jul 19 12:54:30.215653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 12:54:30.217062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] Returning 404 to user: Instance 91b29d50-f252-4413-b2aa-cdfcca1abd76 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:54:30.217062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-846f919a-193a-4bb0-ae64-1ad8ceeb3cfb tempest-ServerRescueNegativeTestJSON-1866945952 tempest-ServerRescueNegativeTestJSON-1866945952-project] 10.222.0.13 "GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76" status: 404 len: 111 microversion: 2.1 time: 0.031095 Jul 19 12:54:30.217062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 772/1403] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:30 2022] GET /compute/v2.1/servers/91b29d50-f252-4413-b2aa-cdfcca1abd76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:54:30.217327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:30.217327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:30.218172 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=68 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:30.224440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:30.224900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:30.225702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:30.226135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:30.289848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:30.292106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:30.298946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ba6dc390-376d-4ac5-8e04-48cbbbd83482 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088556 Jul 19 12:54:30.299522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 632/1404] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:30 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:30.503928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:30.504866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:30.511955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:30.512432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:30.513225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:30.513659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:30.645230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:30.653247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-689c1124-8f9b-42cf-a809-1e54bf354068 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.153170 Jul 19 12:54:30.653896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 773/1405] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:30 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:31.315107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:31.315721 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:31.322446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:31.322908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:31.323680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:31.324115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:31.392715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:31.401781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6bc7d7c3-057e-4f60-8a81-788da01af1f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090710 Jul 19 12:54:31.402371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 633/1406] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:31.670940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:31.672123 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:31.678614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:31.679078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:31.679863 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:31.680334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:31.820690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:31.829093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3ab44663-8314-479d-9bc1-ad4292cc15bc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.162473 Jul 19 12:54:31.829657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 774/1407] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:31 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:32.419143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:32.420484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:32.427234 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:32.427933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:32.428855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:32.429307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:32.506406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:32.519082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a1497c90-6435-4483-aece-d250ac998094 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.103759 Jul 19 12:54:32.520676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 634/1408] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:32.852021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:32.853272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:32.864956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:32.865493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:32.866423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:32.866859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:33.246878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:33.255166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-70a987e8-aff4-4726-9b18-7cf4bd0ff2fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.412770 Jul 19 12:54:33.255744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 775/1409] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:32 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:33.537888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:33.538606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:33.547229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:33.547778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:33.548735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:33.549251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:33.636654 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:33.646010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1297f723-078e-4e14-8e12-314f9ac09779 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.112438 Jul 19 12:54:33.655592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 635/1410] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:34.262326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:54:34.262819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 12:54:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:54:34.272825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:34.274152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:34.281075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:34.281546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:34.282301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:34.282744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:34.421355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:34.429647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0f86f2bb-54d5-4a4f-a44a-5e3ef4bc2de9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.160545 Jul 19 12:54:34.430322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 776/1411] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:34 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:34.663690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:34.664439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:34.671523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:34.672050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:34.672913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:34.673425 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:34.741388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:34.749685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4509eaab-0fcf-41ac-8889-d04f14b6dc71 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.090752 Jul 19 12:54:34.750362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 636/1412] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:35.447653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:35.448300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:35.456247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:35.456826 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:35.457697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:35.458372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:35.610072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:35.623759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc2f0ba3-0add-497f-9d5c-2e0e060f08f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.180081 Jul 19 12:54:35.624673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 777/1413] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:35 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:35.766980 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:35.767742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:35.774679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:35.775264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:35.777029 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:35.777601 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:35.846369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:35.855069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1a48a45a-d584-4955-a2fa-8b64c82e70b3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.092536 Jul 19 12:54:35.855785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 637/1414] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:36.344282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:54:36.344480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:54:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:54:36.642368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:36.643565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:36.650688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:36.651139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:36.651912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:36.652386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:36.826182 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:36.835022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-20b0a3bf-9004-4b8b-ae73-3e683d9c2e72 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.196662 Jul 19 12:54:36.839223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 778/1415] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:36 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:36.872301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:36.872917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:36.883083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:36.883535 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:36.884544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:36.885063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:36.951608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:36.962483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-493c08d2-fdd7-4f69-8e37-b5d44e31e4ce tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.093480 Jul 19 12:54:36.963582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 638/1416] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:37.853343 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:37.855931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:37.863912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:37.864694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:37.865672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:37.866447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:37.979162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:37.979786 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:37.986637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:37.987385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:37.988396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:37.989006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:38.086777 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:38.095246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ad983a5b-3501-4ad6-af48-c0fc9f62a4d4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.119977 Jul 19 12:54:38.104615 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 639/1417] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:38.147368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:38.161112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-904080fd-3be2-4d38-953f-cf13e1463093 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.311936 Jul 19 12:54:38.172762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 779/1418] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:37 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:39.018627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-abf71da2-f1c9-4db5-83f0-fb5d41f20df1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Action: 'create', calling method: .version_select at 0x7fd9943ce160>, body: {"keypair": {"name": "tempest-keypair-645717984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0NZ93UHYxmqJUklCAek0HN6BuH2q06ixSGPnE9f2EtCa/QEBDktB7TsUDiRKNwFnjGaD6+g8KtaO3JH3T/oIscMBvZsmwJUws7CWoyeHJlSYrtV3NI2oO+8npK4GWfmA=="}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:54:39.033420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-abf71da2-f1c9-4db5-83f0-fb5d41f20df1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:54:39.038138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-abf71da2-f1c9-4db5-83f0-fb5d41f20df1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for user 93ebf48bf50b455fa85d3e7ad9164a04 and project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:54:39.061379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-abf71da2-f1c9-4db5-83f0-fb5d41f20df1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.177948 Jul 19 12:54:39.061984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 640/1419] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Jul 19 12:54:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 19 12:54:39.112450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:39.115877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:39.123234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:39.123737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:39.124681 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:39.125150 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:39.178649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:39.179281 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:39.186143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:39.186620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:39.187474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:39.187920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:39.202232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:39.210992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-652fac64-bf4c-41cd-a0ba-2dd918b3a933 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.102416 Jul 19 12:54:39.211803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 780/1420] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:39.382852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:39.392111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e16b52e2-f60e-4b23-8c0a-853ece2951cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.217416 Jul 19 12:54:39.403565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 641/1421] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:39 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:40.229387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:40.230605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:40.238542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:40.239014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:40.239789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:40.240261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:40.344327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:40.362377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b85fbd6-4834-4918-8159-f39013772e03 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.137373 Jul 19 12:54:40.362981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 781/1422] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:40.409547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:40.410817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:40.423034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:40.423570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:40.424458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:40.424964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:40.429069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1258214775", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9a061e3-8575-4b9d-bb9f-6929998aae70"}], "security_groups": [{"name": "tempest-securitygroup--1669426317"}], "key_name": "tempest-keypair-645717984", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:54:40.597900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] validate_networks() for [('e9a061e3-8575-4b9d-bb9f-6929998aae70', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:54:40.606597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:40.618210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-97e6b839-421a-408f-835f-757f43c1a4e5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.211861 Jul 19 12:54:40.619325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 642/1423] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:40 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:41.090112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:54:41.090543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:54:41.091018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:54:41.091429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:54:41.091842 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:54:41.101310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:41.101768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:41.102786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:41.103453 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:41.125059 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:54:41.129291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for user 93ebf48bf50b455fa85d3e7ad9164a04 and project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:54:41.142701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:54:41.145097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:54:41.195381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fcad6b64-5565-4d8c-9efc-14d0df88e048 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.777611 Jul 19 12:54:41.196234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 782/1424] 10.222.0.13 () {62 vars in 1187 bytes} [Tue Jul 19 12:54:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 12:54:41.207021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-780557a2-acf8-4afb-a1b8-1d0ed84af745 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:41.207969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-780557a2-acf8-4afb-a1b8-1d0ed84af745 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:41.268131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-780557a2-acf8-4afb-a1b8-1d0ed84af745 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:41.275416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-780557a2-acf8-4afb-a1b8-1d0ed84af745 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:41.277226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-780557a2-acf8-4afb-a1b8-1d0ed84af745 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:41.278327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-780557a2-acf8-4afb-a1b8-1d0ed84af745 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1281 microversion: 2.20 time: 0.075505 Jul 19 12:54:41.279367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 643/1425] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:41 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:41.379812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:41.380550 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:41.389252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:41.389804 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:41.391244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:41.391776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:41.460657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:41.472606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3e8781d3-036e-4490-a6a2-5615d85b450f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.097026 Jul 19 12:54:41.473271 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 783/1426] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:41.639240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:41.640931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:41.649434 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:41.649900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:41.651458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:41.652100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:41.826690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:41.845190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-88c8713f-044e-4535-8af2-c6a9043427e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.211390 Jul 19 12:54:41.846360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 644/1427] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:41 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:42.296944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:42.297554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:42.303734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:42.304222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:42.305141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:42.305623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:42.413615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:42.428630 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:42.430340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:42.432728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29cb5b92-e306-4ac9-91ba-1cf7156b8329 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1341 microversion: 2.20 time: 0.139034 Jul 19 12:54:42.434339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 784/1428] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:42 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1341 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:42.489257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:42.489883 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:42.497904 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:42.498457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:42.499174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:42.499692 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:42.596706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:42.608465 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-af6c3346-6f6b-4cf0-ab1b-0bc92f947aef tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.123012 Jul 19 12:54:42.609625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 645/1429] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:42 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:42.862826 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:42.863439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:42.869601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:42.870047 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:42.870807 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:42.871234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:43.076634 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:43.084615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2bd3399c-39e7-4e5d-9465-145a2a71491f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.225535 Jul 19 12:54:43.085370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 785/1430] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:42 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:43.453675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:43.454568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:43.461582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:43.462162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:43.462846 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:43.463290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:43.625224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:43.625834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:43.632268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:43.632891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:43.633814 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:43.634249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:43.697079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:43.704985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:43.706576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:43.707750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2969818a-6601-4357-90af-3cd0d745bcee tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1407 microversion: 2.20 time: 0.258762 Jul 19 12:54:43.708415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 646/1431] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:43 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:43.755956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:43.764234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22d38bba-8bc3-4243-b655-b97c93a6d57b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.142924 Jul 19 12:54:43.765344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 786/1432] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:44.102333 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:44.102986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:44.111352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:44.111810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:44.112633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:44.113073 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:44.294181 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-ae11d28b-40a3-41a9-bf09-f4613fa5bc70 req-7e1b0bf9-98d5-4138-906a-57d6704cbe50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beddcf3c-9050-464a-ae8b-6e09f54bd9cd", "tag": "91bb6764-d84f-4b06-9b58-a57ac64d386d"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:54:44.303157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-ae11d28b-40a3-41a9-bf09-f4613fa5bc70 req-7e1b0bf9-98d5-4138-906a-57d6704cbe50 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:44.303613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-ae11d28b-40a3-41a9-bf09-f4613fa5bc70 req-7e1b0bf9-98d5-4138-906a-57d6704cbe50 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:44.325579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-ae11d28b-40a3-41a9-bf09-f4613fa5bc70 req-7e1b0bf9-98d5-4138-906a-57d6704cbe50 service nova] Creating event network-changed:91bb6764-d84f-4b06-9b58-a57ac64d386d for instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd on hv-cinder-82099 Jul 19 12:54:44.330793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-ae11d28b-40a3-41a9-bf09-f4613fa5bc70 req-7e1b0bf9-98d5-4138-906a-57d6704cbe50 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040844 Jul 19 12:54:44.331653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 787/1433] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 12:54:44.381442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:44.390808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c762ce32-30ec-44c4-9cea-a9e6f1c9d5e9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.292004 Jul 19 12:54:44.392222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 647/1434] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:44 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:44.728014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:44.729239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:44.735604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:44.736163 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:44.737020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:44.737459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:44.781716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:44.782480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:44.789254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:44.789706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:44.790476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:44.791541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:44.866492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:44.874453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1a2a7357-19fd-4f71-905d-55c709954577 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.096654 Jul 19 12:54:44.875028 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 648/1435] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:44.897553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:44.905950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:44.907453 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:44.908583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25a13ca9-6c17-4aab-b0d7-1b2a60862c09 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1407 microversion: 2.20 time: 0.185631 Jul 19 12:54:44.909142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 788/1436] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:44 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:45.408719 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:45.409332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:45.415340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:45.415807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:45.416603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:45.417042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:45.624047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:45.631978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-97ebf321-a13a-4b10-9e60-63710799fca3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.227096 Jul 19 12:54:45.632588 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 649/1437] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:45 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:45.891674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:45.892312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:45.898664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:45.899124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:45.899869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:45.900379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:45.926923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:45.927530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:45.934951 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:45.935680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:45.936487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:45.936930 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:45.970747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:45.979614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a31210c3-2cd7-4afe-9f9a-ffe14027135c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.092034 Jul 19 12:54:45.980204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 789/1438] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:46.079523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:46.087574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:46.089161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:46.090272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-be150a90-f870-493c-90e0-f766c54a3b36 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1407 microversion: 2.20 time: 0.167384 Jul 19 12:54:46.090842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 650/1439] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:45 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:46.649871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:46.651010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:46.657075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:46.657519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:46.658311 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:46.658780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:46.784834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:46.787094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:46.793898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-604dd202-eb29-4f27-8501-52d67e1d1d7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147895 Jul 19 12:54:46.794465 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 790/1440] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:46 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:46.996746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:46.997329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:47.004393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:47.004844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:47.005658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:47.006097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:47.021304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:47.067845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:47.076318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2cb2a88e-857a-4f4c-8d58-7f3ecd7aacb6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083994 Jul 19 12:54:47.076882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 651/1441] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:47.107086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:47.107689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:47.114088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:47.114542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:47.115309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:47.115747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:47.246246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:47.254194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:47.255632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:47.256764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c44909c0-bb07-4c36-9363-cf384451baf3 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1407 microversion: 2.20 time: 0.153609 Jul 19 12:54:47.257328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 791/1442] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:47 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:47.810702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:47.811347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:47.817558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:47.818009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:47.818762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:47.819197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:47.963108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:47.971232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ed3e85f5-3084-4c19-ab31-30f425bbb4b6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.164329 Jul 19 12:54:47.971811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 652/1443] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:47 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:48.093305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:48.093924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:48.100101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:48.100587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:48.101362 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:48.101805 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:48.164625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:48.172728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-832ffed9-d045-4284-a036-5894bc0b2a58 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083256 Jul 19 12:54:48.173307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 792/1444] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:48.274935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:48.276151 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:48.282654 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:48.283100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:48.283863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:48.284317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:48.416360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:48.424307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:48.425854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:48.427098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3d9ba375-10c0-4442-9f5e-1a03de61586c tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1407 microversion: 2.20 time: 0.156081 Jul 19 12:54:48.427764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 653/1445] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:48 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:48.988932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:48.989451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:48.996062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:48.996530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:48.997284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:48.997714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:49.123548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:49.131682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb054c23-d692-43a3-b6f4-06c1497b7c07 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146650 Jul 19 12:54:49.132264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 793/1446] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:48 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:49.188662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:49.189271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:49.195207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:49.195657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:49.196438 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:49.196898 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:49.255922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:49.263699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-eb90e58c-8776-4982-a856-76f8df425e6e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.078940 Jul 19 12:54:49.264278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 654/1447] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:49.445251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:49.445854 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:49.451696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:49.452140 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:49.452933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:49.453365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:49.583969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:49.592277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:49.593771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:49.594866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-68c3a29b-4a2c-4e59-ba6c-9392434fe401 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1407 microversion: 2.20 time: 0.153596 Jul 19 12:54:49.595426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 794/1448] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:49 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:49.968619 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-fd07895c-847c-4bd8-84e1-ba190623c0fb req-22f951ca-91c2-45b9-bedf-fe056a8d15e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beddcf3c-9050-464a-ae8b-6e09f54bd9cd", "name": "network-vif-plugged", "status": "completed", "tag": "91bb6764-d84f-4b06-9b58-a57ac64d386d"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:54:49.976743 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-fd07895c-847c-4bd8-84e1-ba190623c0fb req-22f951ca-91c2-45b9-bedf-fe056a8d15e1 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:49.977191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-fd07895c-847c-4bd8-84e1-ba190623c0fb req-22f951ca-91c2-45b9-bedf-fe056a8d15e1 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:49.988138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-fd07895c-847c-4bd8-84e1-ba190623c0fb req-22f951ca-91c2-45b9-bedf-fe056a8d15e1 service nova] Creating event network-vif-plugged:91bb6764-d84f-4b06-9b58-a57ac64d386d for instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd on hv-cinder-82099 Jul 19 12:54:49.992995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-fd07895c-847c-4bd8-84e1-ba190623c0fb req-22f951ca-91c2-45b9-bedf-fe056a8d15e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083783 Jul 19 12:54:49.993594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 655/1449] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:54:50.149446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:50.149965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:50.156479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:50.156865 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:50.157638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:50.158044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:50.281154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:50.281870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:50.288057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:50.288558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:50.289361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:50.289805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:50.297324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:50.305162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a9230b3-84e4-40f2-b80c-40c7d76e430d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.159661 Jul 19 12:54:50.305736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 795/1450] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:50 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:50.353649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:50.362056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cf68bdb8-1614-475e-84e1-731d807093d0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085224 Jul 19 12:54:50.362664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 656/1451] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:50.613019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:50.613635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:50.620751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:50.621245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:50.622012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:50.622445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:50.748053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:50.755941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:50.757474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:50.758576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d317f20-9bf2-454a-ac78-631750d2322b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1407 microversion: 2.20 time: 0.149398 Jul 19 12:54:50.759137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 796/1452] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:50 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:51.322513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:51.323643 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:51.326084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:51.332138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.332601 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:51.333352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.333787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:51.379034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:51.379645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:51.381539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:51.382221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:51.389256 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.389707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:51.390736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.391171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:51.462409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:51.470937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75e1898f-3e53-47ad-b3d5-9a5cf3df09ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.095641 Jul 19 12:54:51.471510 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 797/1453] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:51.489955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:51.498236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4162954f-7f0d-4e16-a8c9-b97e4c7430e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.179628 Jul 19 12:54:51.498791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 657/1454] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:51 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:51.777529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:51.778148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:51.784361 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.784849 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:51.785646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.786083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:51.916171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:51.924562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:51.926076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:51.927273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d06f66e-0d77-4cad-a32e-828f9d996446 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1599 microversion: 2.20 time: 0.154804 Jul 19 12:54:51.927840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 798/1455] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 12:54:51 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 12:54:51.944389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-beca4abc-9341-4c74-80bd-b4878d6ed570 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:51.944891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-beca4abc-9341-4c74-80bd-b4878d6ed570 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:51.951323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beca4abc-9341-4c74-80bd-b4878d6ed570 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.951807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beca4abc-9341-4c74-80bd-b4878d6ed570 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:51.952605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beca4abc-9341-4c74-80bd-b4878d6ed570 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:51.953047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beca4abc-9341-4c74-80bd-b4878d6ed570 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:52.031440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-beca4abc-9341-4c74-80bd-b4878d6ed570 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090892 Jul 19 12:54:52.032042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 658/1456] 10.222.0.13 () {60 vars in 1315 bytes} [Tue Jul 19 12:54:51 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:54:52.486999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:52.487616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:52.494018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:52.494992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:52.496164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:52.496308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:52.516450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:52.517073 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:52.523386 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:52.523843 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:52.524798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:52.525415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:52.570891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:52.579753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47f7a3aa-8dd8-446c-91dd-4949ce37ceff tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.096559 Jul 19 12:54:52.580359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 799/1457] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:52.770950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:52.779133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-25b46f68-460b-434f-9c4d-bff89559734e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.267585 Jul 19 12:54:52.779707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 659/1458] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:52 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:53.039149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-af361531-b9ea-4402-84fd-6c5ce70b8b4b req-39e8a954-aea3-46fc-89d6-b42dd526e799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beddcf3c-9050-464a-ae8b-6e09f54bd9cd", "tag": "91bb6764-d84f-4b06-9b58-a57ac64d386d"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:54:53.047881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-af361531-b9ea-4402-84fd-6c5ce70b8b4b req-39e8a954-aea3-46fc-89d6-b42dd526e799 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:53.048359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-af361531-b9ea-4402-84fd-6c5ce70b8b4b req-39e8a954-aea3-46fc-89d6-b42dd526e799 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:53.059129 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-af361531-b9ea-4402-84fd-6c5ce70b8b4b req-39e8a954-aea3-46fc-89d6-b42dd526e799 service nova] Creating event network-changed:91bb6764-d84f-4b06-9b58-a57ac64d386d for instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd on hv-cinder-82099 Jul 19 12:54:53.064298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-af361531-b9ea-4402-84fd-6c5ce70b8b4b req-39e8a954-aea3-46fc-89d6-b42dd526e799 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028745 Jul 19 12:54:53.064902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 800/1459] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:54:53.596614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:53.597903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:53.614094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:53.614564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:53.615364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:53.615808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:53.708945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:53.718188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c7b854a2-c1ce-4d18-97d1-7925b2dcb379 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.125590 Jul 19 12:54:53.718764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 660/1460] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:53 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:53.797374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:53.798082 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:53.804593 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:53.805281 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:53.806265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:53.806686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:53.949564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:53.957937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d57ab012-a5a0-41e8-99aa-e5a8203ea695 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.165490 Jul 19 12:54:53.958577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 801/1461] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:53 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:54.734953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:54.735866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:54.742373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:54.742833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:54.743598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:54.744037 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:54.804599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:54.812899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2db7c483-36f2-4375-8b9f-c8f0ce2dbd77 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081948 Jul 19 12:54:54.813463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 661/1462] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:54.975718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:54.976094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:54.982770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:54.983218 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:54.983997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:54.984461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:55.112088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:55.120538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43c8c8f1-913a-4f1a-b692-a414e2c6ec89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149196 Jul 19 12:54:55.121103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 802/1463] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:54 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:55.829586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:55.830212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:55.836768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:55.837227 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:55.838000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:55.839038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:55.903611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:55.911510 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b0ab9395-9a5a-4a0f-b37f-a7389631fde3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085789 Jul 19 12:54:55.912075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 662/1464] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:56.137853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:56.138469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:56.145275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:56.145725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:56.146488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:56.146927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:56.272561 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:56.280414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-186ac84a-6a7b-4209-8586-f746480a6b3b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147038 Jul 19 12:54:56.280984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 803/1465] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:56 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:54:56.928500 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:56.929042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:56.935594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:56.936050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:56.936845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:56.937289 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:56.997264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:57.005227 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-704e2a8a-7578-4bfe-9ee0-fdb0fb003a01 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080626 Jul 19 12:54:57.005802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 663/1466] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:57.296327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:57.296941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:57.299372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:57.304659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:57.305105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:57.305860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:57.306292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:57.437258 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:57.445092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fb8466b6-702b-485d-813f-1adfb500c78f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152604 Jul 19 12:54:57.445661 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 804/1467] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:57 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:58.022100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:58.022718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:58.029150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:58.029604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:58.030368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:58.030808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:58.092129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:58.099957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-19538366-bc3c-4b40-8a95-a52b71040deb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081695 Jul 19 12:54:58.100557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 664/1468] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:58.462061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:58.462568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:58.469665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:58.470083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:58.470841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:58.471273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:58.598680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:58.607230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-968e525f-9100-46e7-8aff-0c62aca0bbea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149009 Jul 19 12:54:58.607811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 805/1469] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:58 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:59.117317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:59.117928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:59.124992 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:59.125496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:59.126297 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:59.126736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:59.191993 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:59.200705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7bb26108-a645-4efe-a17c-dc996be75226 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.087336 Jul 19 12:54:59.201280 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 665/1470] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:54:59.624963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:54:59.625580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:54:59.632127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:59.632611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:59.633375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:54:59.633817 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:54:59.759385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:54:59.767560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8cebc40-8fb9-4a24-b40a-1a1c87957279 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146461 Jul 19 12:54:59.768135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 806/1471] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:54:59 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:00.221986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:00.222534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:00.224875 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:00.230169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:00.230618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:00.231373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:00.231807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:00.295994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:00.303769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-99f6863e-82e5-4d4a-ad95-22a1f81773bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085692 Jul 19 12:55:00.304366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 666/1472] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:00.785998 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:00.786605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:00.792576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:00.793025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:00.793775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:00.794206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:00.925692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:00.934135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fbd09f79-c36a-460f-8919-cb6006f52dfc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152894 Jul 19 12:55:00.934702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 807/1473] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:00 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:01.320318 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:01.320936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:01.327398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:01.327850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:01.328652 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:01.329094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:01.388927 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:01.396982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7fdb617e-e09f-4f07-a8c2-3e598f088dc0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080542 Jul 19 12:55:01.397549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 667/1474] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:01.951660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:01.952207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:01.958694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:01.959139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:01.959892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:01.960354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:01.962847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:02.086518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:02.094456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52313720-801b-4a62-bede-a68328d2dc15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147630 Jul 19 12:55:02.095020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 808/1475] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:01 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:02.413265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:02.413876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:02.420943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:02.421396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:02.422155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:02.422597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:02.485641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:02.493497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dd42c8fd-382c-468a-9a1e-231150a80c0e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084193 Jul 19 12:55:02.494065 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 668/1476] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:03.111308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:03.111922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:03.118480 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:03.118927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:03.119693 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:03.120124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:03.249326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:03.257205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-302f6648-62b8-4a60-bfa1-6d2daa963b2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149760 Jul 19 12:55:03.257773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 809/1477] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:03 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:03.514267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:03.514267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:03.519707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:03.520356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:03.521142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:03.521586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:03.525686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:03.593027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:03.600893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d26a8373-5d4a-4974-a8e4-67b80234cc5e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.093858 Jul 19 12:55:03.601461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 669/1478] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:03 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:04.274636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:04.275241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:04.281708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:04.282150 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:04.282900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:04.283331 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:04.412135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:04.420020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c22b8fe-696a-48f1-a48e-f3fc056fe159 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149208 Jul 19 12:55:04.420609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 810/1479] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:04 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:04.618175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:04.618829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:04.625934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:04.626390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:04.627156 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:04.627595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:04.690095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:04.697906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-41b81731-a549-4e61-bae5-8f374c3186d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083591 Jul 19 12:55:04.698469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 670/1480] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:05.436981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:05.437709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:05.444131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:05.444608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:05.445363 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:05.445794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:05.572616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:05.581086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b71954bb-9d4c-4797-b097-ed3d6975d471 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147954 Jul 19 12:55:05.581657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 811/1481] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:05 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:05.714293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:05.714906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:05.721319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:05.721765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:05.722517 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:05.722952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:05.785953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:05.793709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-87efad71-cb0d-438a-bfd6-6aa7077b91bc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083308 Jul 19 12:55:05.794263 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 671/1482] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:06.598769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:06.599376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:06.606794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:06.607249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:06.608048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:06.608532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:06.734941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:06.742962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2dbd40fc-d3ae-4a7f-8e72-79aca1bc9ab7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148018 Jul 19 12:55:06.743530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 812/1483] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:06 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:06.810019 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:06.810628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:06.817045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:06.817493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:06.818251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:06.818686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:06.879449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:06.887713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-51d568a9-ed71-4e90-8799-339dab1ba19d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081501 Jul 19 12:55:06.888542 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 672/1484] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:07.760021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:07.760657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:07.767322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:07.767778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:07.768569 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:07.769008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:07.896974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:07.904468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:07.904951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e329b1d5-aef3-4e57-a82d-aebead112e84 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148870 Jul 19 12:55:07.905244 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:07.905522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 813/1485] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:07 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:07.911756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:07.912245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:07.913018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:07.914052 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:07.974622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:07.983054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4ebaf58f-9a3b-4b5f-b3ad-b3cc5b642fa5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082447 Jul 19 12:55:07.983622 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 673/1486] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:08.921468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:08.922073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:08.928520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:08.928996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:08.929753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:08.930188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:08.999664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:09.000328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:09.006770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:09.007223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:09.008031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:09.008442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:09.083875 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:09.087345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:09.091961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-69a803bf-ec4d-4dfc-9d2c-15fc2005d472 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.096735 Jul 19 12:55:09.092578 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 674/1487] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:09.095233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e23aa35e-edef-4e2f-bf41-bb9f27c248ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.177603 Jul 19 12:55:09.095936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 814/1488] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:08 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:10.108314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:10.108942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:10.111761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:10.112412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:10.115476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:10.115928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:10.116721 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:10.117157 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:10.118815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:10.119257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:10.120020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:10.120743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:10.200598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:10.208597 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-77213cba-4caf-4549-afd1-80998d5b4b56 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.104200 Jul 19 12:55:10.209394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 675/1489] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:10.267096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:10.275070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-347ec2c1-333f-4e33-b819-94411062ac7f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.167086 Jul 19 12:55:10.275639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 815/1490] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:10 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:11.225001 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:11.225570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:11.232070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:11.232558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:11.233327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:11.233769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:11.292781 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:11.293305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:11.297546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:11.299830 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:11.300393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:11.301731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:11.301731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:11.305562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5d48eba3-6af4-4889-a249-600e2b9c50b2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084412 Jul 19 12:55:11.306356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 676/1491] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:11.439649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:11.447641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3cd0cc3-431d-404a-b9e8-2a9813dde4c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.159336 Jul 19 12:55:11.448226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 816/1492] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:11 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:12.322577 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:12.323190 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:12.330149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:12.330595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:12.331345 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:12.331787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:12.393729 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:12.401448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-48f3c4f1-c6bc-4c1a-9287-3ee26980e7fe tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082738 Jul 19 12:55:12.402674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 677/1493] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:12.464585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:12.465126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:12.471598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:12.472049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:12.472853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:12.473294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:12.597943 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:12.605874 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52f15c8a-f5a2-4381-8268-760467153570 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145273 Jul 19 12:55:12.606450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 817/1494] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:12 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:13.419243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:13.419909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:13.426412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:13.426865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:13.427630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:13.428069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:13.491390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:13.499283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7a00eab6-7865-444e-811e-48666f83e0bf tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084500 Jul 19 12:55:13.499848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 678/1495] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:13.621978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:13.622590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:13.629066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:13.629520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:13.630274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:13.630707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:13.756591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:13.764883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c371a27-6300-4b95-8951-6ba312c176af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146740 Jul 19 12:55:13.765717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 818/1496] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:13 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:14.516484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:14.517101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:14.523563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:14.524014 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:14.524818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:14.525257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:14.586324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:14.594211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-efb33493-dcee-43a4-9fba-9b4e7d2c077e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081957 Jul 19 12:55:14.594781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 679/1497] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:14 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:14.782645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:14.783174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:14.789884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:14.790338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:14.791108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:14.791549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:14.923589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:14.931513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc3e225d-39c3-4a17-a1f8-9ef01ff04053 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152804 Jul 19 12:55:14.932084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 819/1498] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:14 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:15.610384 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:15.610911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:15.617454 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:15.617914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:15.618686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:15.619128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:15.679728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:15.688021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3b492f3f-99f9-4f1c-be44-930e536accdb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081590 Jul 19 12:55:15.688627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 680/1499] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:15.948645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:15.949171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:15.955694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:15.956154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:15.956955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:15.957394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:16.085930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:16.093859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-26397c20-3084-4b39-b407-c63eba23d772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149235 Jul 19 12:55:16.094459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 820/1500] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:15 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:16.704777 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:16.705380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:16.711806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:16.712286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:16.713041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:16.713472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:16.777994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:16.785849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-386d71d2-331c-4774-af51-1a3b7082d70b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084868 Jul 19 12:55:16.786406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 681/1501] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:17.110134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:17.110687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:17.117108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:17.117564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:17.118326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:17.118763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:17.246595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:17.254495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c5f15bd-a49e-4561-99d4-37361f53610f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148317 Jul 19 12:55:17.255092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 821/1502] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:17 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:17.801711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:17.802323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:17.808958 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:17.809408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:17.810164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:17.810603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:17.870256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:17.878044 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3f88b7c6-c0e9-4804-a2eb-7bd37bb7797c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080196 Jul 19 12:55:17.878602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 682/1503] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:18.272326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:18.272936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:18.279371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:18.279814 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:18.280602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:18.281036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:18.412543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:18.420938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18609887-fe0d-455d-af6e-e8f2daacead8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152468 Jul 19 12:55:18.421526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 822/1504] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:18 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:18.895172 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:18.895724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:18.904317 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:18.905153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:18.906529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:18.907366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:18.980877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:18.989527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1dc96dd8-2c97-4a9a-b02f-b4d1d82574b9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.098211 Jul 19 12:55:18.990181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 683/1505] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:19.438469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:19.439118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:19.445682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:19.446145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:19.446913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:19.447356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:19.575909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:19.583743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7e6e0b12-d393-474f-88c7-3c85eb878d5b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149210 Jul 19 12:55:19.584334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 823/1506] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:19 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:20.005600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:20.006322 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:20.013557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:20.013962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:20.014724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:20.015163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:20.078588 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:20.086602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2c605e5c-723e-4d5f-b7da-718f5f422aa6 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084850 Jul 19 12:55:20.087197 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 684/1507] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:20.601381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:20.602001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:20.609051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:20.609510 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:20.610289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:20.610733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:20.739922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:20.742107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:20.749115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02ae976e-0cdd-4844-9ff8-27a2d4e08098 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151610 Jul 19 12:55:20.749690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 824/1508] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:20 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:21.102790 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:21.103424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:21.109861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:21.110307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:21.111067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:21.111505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:21.172332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:21.174471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:21.181357 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-caf73430-0190-4f91-b7c3-1ce35fa8ab76 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082453 Jul 19 12:55:21.181921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 685/1509] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:21.767014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:21.767630 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:21.774663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:21.775281 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:21.776163 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:21.776750 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:21.908028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:21.915887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9a68eefd-0065-4fc5-aa54-872a02930c20 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.153118 Jul 19 12:55:21.916489 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 825/1510] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:21 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:22.197334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:22.197855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:22.204887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:22.205338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:22.206093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:22.206527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:22.267917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:22.275788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-beafe63e-f467-4553-b636-5b66936ab5bb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082681 Jul 19 12:55:22.276376 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 686/1511] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:22.933268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:22.933828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:22.940962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:22.941413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:22.942177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:22.942614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:23.068640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:23.076490 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-227644d4-9cc9-4a63-96cb-b8fd5204188f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147118 Jul 19 12:55:23.077063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 826/1512] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:22 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:23.292222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:23.292860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:23.299779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:23.300251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:23.301007 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:23.301439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:23.413927 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:23.423979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-41ecde11-8e54-4a1e-8da8-52e9f8c138b7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.135647 Jul 19 12:55:23.424799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 687/1513] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:24.094128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:24.094768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:24.101213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:24.101660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:24.102415 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:24.102846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:24.281315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:24.289162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b7e506fc-18f0-4573-95c0-4f699d13f6a1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.199449 Jul 19 12:55:24.289738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 827/1514] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:24 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:24.440602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:24.441142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:24.447541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:24.447997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:24.448799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:24.449238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:24.511483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:24.520120 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4a08e079-0e82-4499-bd8c-8ec0436188dc tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083405 Jul 19 12:55:24.520720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 688/1515] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:24 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:25.306745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:25.307359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:25.314137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:25.314590 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:25.315353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:25.315789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:25.450573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:25.458484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8521fe98-127c-480e-b5e4-391c02f0d2ee tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.155570 Jul 19 12:55:25.459053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 828/1516] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:25 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:25.537563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:25.538174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:25.544801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:25.545252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:25.546042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:25.546478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:25.607630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:25.615714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f9be2d25-feb5-4049-a2f0-9c7b2024a80d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082212 Jul 19 12:55:25.616319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 689/1517] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:25 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:26.475222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:26.475862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:26.482419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:26.482870 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:26.484071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:26.484071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:26.612238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:26.620267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bcf5f007-6060-4f34-8ed2-aec518a2642b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148938 Jul 19 12:55:26.620834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 829/1518] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:26 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:26.633307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:26.633919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:26.641251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:26.641706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:26.642462 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:26.642899 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:26.708224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:26.716103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0ca3c551-a7c7-404d-97e6-a666d940581b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086534 Jul 19 12:55:26.716701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 690/1519] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:27.637712 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:27.638325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:27.641435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=52 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:27.646717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:27.647174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:27.647934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:27.648400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:27.732367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:27.733535 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:27.740006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:27.740489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:27.741248 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:27.741690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:27.774702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:27.783336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7535b3ea-b8ca-421a-896c-a702a330a374 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149456 Jul 19 12:55:27.783929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 830/1520] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:27 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:27.802674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:27.810488 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-af0763da-1d19-4da6-aa12-d148ce7a87ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081913 Jul 19 12:55:27.811553 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 691/1521] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:27 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:28.800409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:28.801031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:28.807448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:28.807900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:28.808709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:28.809147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:28.827458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:28.828380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:28.835043 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:28.835497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:28.836416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:28.836860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:28.917347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:28.926270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-443f7a6f-6917-415f-9955-0c832a1ffbe0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.103352 Jul 19 12:55:28.926844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 692/1522] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:28 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:29.036725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:29.044619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-81b4a6bb-95cd-49e7-8893-46cdbb1d6b98 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.248109 Jul 19 12:55:29.045692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 831/1523] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:28 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:29.225557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c51d8f6b-ec70-4e14-8603-27fac7966ede tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:29.226058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c51d8f6b-ec70-4e14-8603-27fac7966ede tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:29.232101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51d8f6b-ec70-4e14-8603-27fac7966ede tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:29.233112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51d8f6b-ec70-4e14-8603-27fac7966ede tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:29.233882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51d8f6b-ec70-4e14-8603-27fac7966ede tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:29.234324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c51d8f6b-ec70-4e14-8603-27fac7966ede tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:29.259053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c51d8f6b-ec70-4e14-8603-27fac7966ede tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd/ips" status: 200 len: 152 microversion: 2.20 time: 0.037118 Jul 19 12:55:29.260140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 693/1524] 10.222.0.13 () {60 vars in 1288 bytes} [Tue Jul 19 12:55:29 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 12:55:29.942969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:29.943508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:29.949966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:29.950413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:29.951177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:29.952106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:30.015949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:30.023917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-88dd42d4-1d78-4ed9-a12d-e69153017fcd tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084923 Jul 19 12:55:30.024530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 832/1525] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:29 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:30.062389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:30.062994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:30.069415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:30.069866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:30.070629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:30.071057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:30.197734 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:30.206466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ceb15d93-bd41-4b1c-9ba6-b52312350627 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148361 Jul 19 12:55:30.207035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 694/1526] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:30 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:31.041293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:31.041933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:31.049019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:31.049413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:31.050167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:31.050602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:31.110066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:31.117848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9eb6453a-c75f-4520-a837-d3217e765be3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080468 Jul 19 12:55:31.118412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 833/1527] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:31 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:31.223273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:31.223887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:31.226252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=58 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:31.231442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:31.231896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:31.232686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:31.233124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:31.359642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:31.367435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-147429c5-ca0f-470a-9607-0886860aaa2a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147937 Jul 19 12:55:31.368006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 695/1528] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:31 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:32.134459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:32.135070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:32.142330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:32.142778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:32.143541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:32.143975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:32.205488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:32.213316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f7be867-e439-4714-8868-dc0904f85d66 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082762 Jul 19 12:55:32.214084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 834/1529] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:32 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:32.384803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:32.385330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:32.393069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:32.393518 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:32.394279 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:32.394718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:32.520567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:32.529701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-acafb800-f8a9-4f30-b796-09fca852c368 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149062 Jul 19 12:55:32.530276 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 696/1530] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:32 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:33.230902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:33.231511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:33.239062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:33.239514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:33.240323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:33.240761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:33.304198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:33.311989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f9d811d-b2e6-42d8-b28d-eae9595f0c68 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084987 Jul 19 12:55:33.312589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 835/1531] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:33 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:33.547706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:33.548252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:33.554859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:33.555313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:33.556087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:33.556552 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:33.686623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:33.694436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b4a7a2f5-0235-4c1e-89c4-756ae51340e3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151127 Jul 19 12:55:33.694999 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 697/1532] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:33 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:34.328823 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:34.329423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:34.335787 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:34.336264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:34.337024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:34.337456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:34.397581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:34.405411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-608f6cce-e97f-4a0b-b2bd-304944f525a1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080486 Jul 19 12:55:34.405975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 836/1533] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:34 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:34.711889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:34.712540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:34.719559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:34.720013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:34.720803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:34.721240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:34.850385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:34.859459 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f0d044d0-611f-415c-927f-3b3d0aa5c328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151359 Jul 19 12:55:34.860025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 698/1534] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:34 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:35.422043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:35.422658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:35.429082 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:35.429537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:35.430300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:35.430734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:35.490668 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:35.498439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50cbe4cb-bc49-4a87-9522-d0163ec0d023 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080273 Jul 19 12:55:35.499505 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 837/1535] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:35 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:35.877341 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:35.877955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:35.884560 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:35.885010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:35.885764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:35.886200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:36.010770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:36.018874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-900f83ff-b193-4b8a-b68f-741d69cc7cea tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145932 Jul 19 12:55:36.019435 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 699/1536] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:35 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:36.516485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:36.517124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:36.523522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:36.523973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:36.524783 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:36.525222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:36.587729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:36.596258 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c752194f-714d-493f-8abf-fada88111892 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084397 Jul 19 12:55:36.596859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 838/1537] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:36 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:37.035953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:37.036610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:37.042995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:37.043446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:37.044224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:37.044662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:37.169261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:37.177611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f2f5f316-fe3a-4b53-969e-6be2400e8f8f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145581 Jul 19 12:55:37.178168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 700/1538] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:37 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:37.614255 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:37.614876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:37.621457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:37.621906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:37.622671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:37.623118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:37.683779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:37.691631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fac3aa53-6a74-458e-89ab-12803464552a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081499 Jul 19 12:55:37.692221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 839/1539] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:37 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:38.194955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:38.195562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:38.202495 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:38.202942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:38.203695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:38.204130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:38.330962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:38.338774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a27a4aa1-8e35-4cbb-abbb-469e6c00d4a2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147691 Jul 19 12:55:38.339336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 701/1540] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:38 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:38.708152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:38.708786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:38.715240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:38.715686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:38.716485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:38.716925 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:38.779138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:38.787243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1da7ca5c-d188-451c-9239-99eaacb531f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082924 Jul 19 12:55:38.787820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 840/1541] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:38 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:39.354941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:39.355571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:39.362726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:39.363170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:39.363925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:39.364397 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:39.489453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:39.491644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:39.498470 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fa4cbf76-1003-4f22-9d0e-6c70e1dda7eb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147367 Jul 19 12:55:39.499058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 702/1542] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:39 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:39.804637 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:39.805248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:39.812131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:39.812619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:39.813376 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:39.813811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:39.829370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:39.879278 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:39.887224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4db6cc15-617d-47c1-b915-f9cf13695944 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086477 Jul 19 12:55:39.887789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 841/1543] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:39 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:40.516038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:40.516714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:40.523143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:40.523587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:40.524375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:40.524810 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:40.649851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:40.658198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f7452a60-7e39-4300-b73e-39a37650f61d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146223 Jul 19 12:55:40.658762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 703/1544] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:40 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:40.904768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:40.905288 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:40.912336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:40.912786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:40.913540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:40.913971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:40.973548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:40.981254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3dee93bd-ca91-4699-b9b6-7fb15a47e80b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080400 Jul 19 12:55:40.981820 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 842/1545] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:40 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:41.676375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:41.676984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:41.683321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:41.683801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:41.684577 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:41.685011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:41.818297 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:41.826145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dcf4be4d-ae3c-4860-ab14-4debfbb01f60 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.153681 Jul 19 12:55:41.826707 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 704/1546] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:41 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:41.997616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:41.998226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:42.005317 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:42.005763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:42.006523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:42.006958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:42.066799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:42.074508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1ec17dba-60aa-4101-93b4-f47f941a5bd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080709 Jul 19 12:55:42.075066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 843/1547] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:41 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:42.842768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:42.843299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:42.849820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:42.850272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:42.851031 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:42.851469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:42.982129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:42.990010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-82c616cf-191e-42b8-ae75-ec4f6b4a4c44 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151168 Jul 19 12:55:42.990573 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 705/1548] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:42 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:43.090748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:43.091353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:43.097777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:43.098166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:43.098922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:43.099358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:43.163396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:43.171216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ef6ec43a-866f-44fe-b1e1-4da9093245f7 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084271 Jul 19 12:55:43.172307 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 844/1549] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:43 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:44.006847 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:44.007460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:44.013957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:44.014407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:44.015164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:44.015852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:44.143943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:44.151886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fb3a0713-48e0-4bc2-a5e0-730564ec163b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148958 Jul 19 12:55:44.152478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 706/1550] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:44 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:44.188000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:44.188676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:44.195157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:44.195608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:44.196401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:44.196839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:44.257528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:44.265218 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-20cb0e38-ffb5-4fdc-a58b-fd5764f8ea57 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081004 Jul 19 12:55:44.266042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 845/1551] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:44 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:45.169742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:45.170351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:45.177756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:45.178213 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:45.178984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:45.179417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:45.282976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:45.283606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:45.289984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:45.290432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:45.291240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:45.291618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:45.308838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:45.316720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-817e4193-4a70-49d2-92f9-f5995dcece47 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150877 Jul 19 12:55:45.317301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 707/1552] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:45 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:45.352949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:45.360708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2412f8d9-0375-4591-883f-131ddd8fd6a5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082009 Jul 19 12:55:45.361279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 846/1553] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:45 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:46.333981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:46.334600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:46.341141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:46.341604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:46.342377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:46.342825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:46.377906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:46.378513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:46.385039 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:46.385485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:46.386247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:46.386676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:46.463149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:46.471566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64568aef-d338-4633-b3bc-c19581d746ea tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.098115 Jul 19 12:55:46.472142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 847/1554] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:46 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:46.492779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:46.500544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e1cf86bd-ac01-4cf1-a833-a17ea147b29d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.170671 Jul 19 12:55:46.501150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 708/1555] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:46 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:47.488896 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:47.489531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:47.495965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:47.496445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:47.497206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:47.497636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:47.518094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:47.518800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:47.525393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:47.525845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:47.526606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:47.527048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:47.562154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:47.570159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e859e332-ad4e-4d85-84c3-e29e0c721d3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085803 Jul 19 12:55:47.570733 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 848/1556] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:47 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:47.655251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:47.663484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-99d42c01-5882-4179-9b1a-954303d201ab tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149481 Jul 19 12:55:47.664053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 709/1557] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:47 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:48.586958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:48.587565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:48.594026 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:48.594471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:48.595266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:48.595700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:48.656844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:48.664573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-70beb37e-eb98-4e68-beb5-7a830e1b4a35 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081431 Jul 19 12:55:48.665128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 849/1558] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:48 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:48.680143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:48.680780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:48.687207 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:48.687573 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:48.688971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:48.689411 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:49.048327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:49.056111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-de4d3175-822c-4db4-8f90-911f0d473da0 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.379714 Jul 19 12:55:49.056699 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 710/1559] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:48 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:49.681621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:49.682240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:49.689275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:49.689730 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:49.690523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:49.690960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:49.752349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:49.760461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b54fa603-a204-4b2f-8909-545c1e90d2ba tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082651 Jul 19 12:55:49.761052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 850/1560] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:49 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:50.073220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:50.073825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:50.080312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:50.080762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:50.081514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:50.081943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:50.211166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:50.219082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9491ff4f-b785-4ee1-a6d1-2ce289d15cf5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149681 Jul 19 12:55:50.220136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 711/1561] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:50 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:50.778333 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:50.778945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:50.785942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:50.786389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:50.787155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:50.787589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:50.849859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:50.857739 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fd668aba-6a79-4c71-90b1-6c143a188998 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083304 Jul 19 12:55:50.858303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 851/1562] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:50 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:51.236516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:51.237134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:51.243503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:51.243978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:51.244785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:51.245225 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:51.370969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:51.379482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7686f2a7-5327-4dee-b286-6a92d61a21bb tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146771 Jul 19 12:55:51.380088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 712/1563] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:51 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:51.874922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:51.875509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:51.882315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:51.882777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:51.883565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:51.884008 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:51.948636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:51.956786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36ce76d2-4c7f-4e35-81fa-7eb4dcffd85c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085981 Jul 19 12:55:51.957368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 852/1564] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:51 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:52.397267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:52.397882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:52.404339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:52.404795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:52.405559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:52.405998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:52.534710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:52.542468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8e80df59-9456-441a-ab5f-70e230ac5e4a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149070 Jul 19 12:55:52.543026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 713/1565] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:52 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:52.973551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:52.974088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:52.980601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:52.981061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:52.981823 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:52.982260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:53.044556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:53.052843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ae1cfa4b-6fa6-4614-a9d0-f7ac6dc09fde tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083284 Jul 19 12:55:53.053412 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 853/1566] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:52 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:53.558747 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:53.559351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:53.565783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:53.566236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:53.566995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:53.567425 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:53.691829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:53.699759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-594972f1-a56a-4826-a22d-d4f00f48d6d8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.144871 Jul 19 12:55:53.700353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 714/1567] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:53 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:54.069851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:54.070464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:54.076890 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:54.077342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:54.078107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:54.078541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:54.141146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:54.149716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e89c9dd1-ba43-4dc8-881e-92c2db66952a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083727 Jul 19 12:55:54.150301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 854/1568] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:54 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:54.717209 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:54.717821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:54.724603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:54.725062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:54.725825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:54.726266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:54.851430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:54.859248 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c0010ba7-3da9-48f7-9b6a-03554b7ce60b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145905 Jul 19 12:55:54.859816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 715/1569] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:54 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:55.165674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:55.166193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:55.172496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:55.172950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:55.173714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:55.174261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:55.233852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:55.241683 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c56eada-4bcb-428a-9bda-64b64716889d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080035 Jul 19 12:55:55.242257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 855/1570] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:55 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:55.876755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:55.877892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:55.884362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:55.884819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:55.885583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:55.886023 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:56.013221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:56.021401 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9609e39f-1777-48f7-bdcb-9dd11851760b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148539 Jul 19 12:55:56.021972 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 716/1571] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:55 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:56.259072 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:56.259688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:56.266437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:56.266887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:56.267648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:56.268085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:56.327844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:56.335727 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57a6b8ac-5205-49a3-9797-3e49a1a2a79a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080477 Jul 19 12:55:56.336326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 856/1572] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:56 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:55:57.038902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:57.039514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:57.046052 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:57.046500 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:57.047249 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:57.047685 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:57.173843 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:57.181626 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c4f7c770-3eec-4127-a3ce-d35cb74b1484 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146526 Jul 19 12:55:57.182366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 717/1573] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:57 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:57.351416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:57.351953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:57.358386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:57.358833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:57.359584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:57.360016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:57.422899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:57.431050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bfbe25ed-2a63-460a-a944-f7910b59a248 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083507 Jul 19 12:55:57.431611 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 857/1574] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:57 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:58.198530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:58.199153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:58.205569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:58.206020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:58.206768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:58.207202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:58.331607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:58.339347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3badf16a-9c78-4888-a529-e1a4817a841d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.144655 Jul 19 12:55:58.339915 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 718/1575] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:58 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:58.447959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:58.448652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:58.450910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=56 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:58.457154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:58.457606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:58.458374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:58.458812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:58.462697 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:58.520734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:58.528593 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-06b4bbc4-4649-48fd-bc7f-b1d942ebd977 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.084438 Jul 19 12:55:58.529156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 858/1576] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:58 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:59.357118 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:59.357714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:59.364692 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:59.365142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:59.365901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:59.366358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:59.381356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:55:59.495694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:59.504092 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6fe88949-9c5a-4c06-ab71-a0a546a02860 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150856 Jul 19 12:55:59.504683 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 719/1577] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:59 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:55:59.545957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:55:59.546578 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:55:59.553545 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:59.553999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:59.554764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:55:59.555206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:55:59.616048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:55:59.623968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-12b2d61f-799c-4601-94b9-51ce22f5cc08 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081872 Jul 19 12:55:59.624572 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 859/1578] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:55:59 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:00.522856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:00.523523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:00.530192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:00.530643 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:00.531407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:00.531842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:00.644079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:00.644724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:00.651111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:00.651582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:00.652354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:00.652790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:00.658706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:00.666682 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3d4fe3a9-db74-44ab-8c4e-5cfe3e720238 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147876 Jul 19 12:56:00.667251 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 720/1579] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:00 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:00.719458 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:00.727506 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-68eaf07f-18f9-49ce-867d-eee361be7886 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.088097 Jul 19 12:56:00.728105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 860/1580] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:00 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:01.684148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:01.684787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:01.687056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=52 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:01.692841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:01.693288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:01.694049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:01.694482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:01.744798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:01.745386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:01.751760 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:01.752710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:01.753473 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:01.753905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:01.833147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:01.841803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-830dc109-5a38-4f6e-a020-670772b86257 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.161354 Jul 19 12:56:01.842423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 721/1581] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:01 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:01.962493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:01.970195 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10390168-fc30-4713-a034-053bf06d6565 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.229302 Jul 19 12:56:01.970853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 861/1582] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:01 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:02.859169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:02.859720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:02.866229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:02.866680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:02.867436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:02.867869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:02.986833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:02.987444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:02.993734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:02.994183 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:02.994950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:02.995387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:02.997689 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:03.005604 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1290cb8e-6406-4524-8298-cdd684837eb7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150340 Jul 19 12:56:03.006175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 722/1583] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:02 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:03.056305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:03.064104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1097901-91c1-40af-a6f1-c252e2fd0f0a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081173 Jul 19 12:56:03.064718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 862/1584] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:02 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:04.022551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:04.023162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:04.029587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:04.030033 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:04.030796 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:04.031231 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:04.080893 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:04.081527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:04.087951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:04.088429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:04.089200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:04.089637 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:04.168769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:04.177146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52bca92c-8bd6-4193-814f-6dada3fc4cb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.100079 Jul 19 12:56:04.177709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 863/1585] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:04 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:04.186518 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:04.194834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d72b3c2a-e53f-4c4b-b804-8220616ff956 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.176137 Jul 19 12:56:04.195402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 723/1586] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:04 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:05.194891 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:05.195511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:05.202335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:05.202793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:05.203560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:05.203995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:05.211192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:05.212473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:05.219062 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:05.220247 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:05.221219 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:05.221673 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:05.272159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:05.280150 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6e1c690-ebbc-4b12-8634-6459949a540a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.089774 Jul 19 12:56:05.280751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 864/1587] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:05 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:05.362886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:05.371226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-94812a63-a638-4cbb-b806-4f823856545c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.163868 Jul 19 12:56:05.371802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 724/1588] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:05 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:06.296675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:06.297282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:06.303636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:06.304084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:06.304876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:06.305303 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:06.367797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:06.375601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c47555df-a2c9-41fa-973f-63f6b37d5519 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082778 Jul 19 12:56:06.376151 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 865/1589] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:06 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:06.388274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:06.388897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:06.396228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:06.396683 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:06.397445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:06.397886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:06.523657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:06.531650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-22a15049-62e0-41da-82bd-520921e6ad28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147357 Jul 19 12:56:06.532240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 725/1590] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:06 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:07.393053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:07.393667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:07.400322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:07.400777 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:07.401543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:07.401981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:07.462555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:07.470366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-58c4696a-73f8-418c-8376-a798a1ee71c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081486 Jul 19 12:56:07.470923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 866/1591] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:07 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:07.548441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:07.549053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:07.555748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:07.556233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:07.557004 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:07.557446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:07.685870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:07.693774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a00a5707-19d4-4d85-bcaa-bd1bff7f1c8b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149199 Jul 19 12:56:07.694339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 726/1592] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:07 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:08.487685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:08.488328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:08.494735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:08.495188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:08.495952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:08.496419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:08.558847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:08.567086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b12abc9-3ae0-4143-8201-05e940329a3a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083300 Jul 19 12:56:08.567643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 867/1593] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:08 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:08.710166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:08.710780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:08.717272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:08.717722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:08.718483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:08.718922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:08.844095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:08.852491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-40dc1891-b8f9-447b-bc2c-5fb94648d083 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146205 Jul 19 12:56:08.853067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 727/1594] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:08 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:09.584283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:09.584898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:09.591328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:09.591779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:09.592575 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:09.593011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:09.657090 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:09.664943 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da914ec8-a6ee-4efc-a106-2bc3ce475b84 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085193 Jul 19 12:56:09.665509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 868/1595] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:09 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:09.869881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:09.870427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:09.876866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:09.877315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:09.878068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:09.878502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:10.004887 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:10.012755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-429b455d-6460-44ad-b30d-23822f3cf4de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146727 Jul 19 12:56:10.013330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 728/1596] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:09 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:10.681433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:10.682085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:10.688565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:10.689020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:10.689787 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:10.690225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:10.750096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:10.757908 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6d8f4b25-64a1-4f01-b9b5-1d31f051655e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.080317 Jul 19 12:56:10.758468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 869/1597] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:10 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:11.030196 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:11.030812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:11.037730 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:11.038185 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:11.038946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:11.039387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:11.170334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:11.178784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-33457c23-9b82-4487-aa09-01cc68dbae61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152439 Jul 19 12:56:11.179351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 729/1598] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:11 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:11.775456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:11.776091 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:11.782620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:11.783078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:11.783851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:11.784317 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:11.846979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:11.854987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0b6dda5c-a58d-41e3-abb8-2d7767dc4a3b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083529 Jul 19 12:56:11.855553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 870/1599] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:11 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:12.196468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:12.197082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:12.203556 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:12.204013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:12.204850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:12.205292 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:12.334335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:12.342115 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b4343a6c-075d-4102-a5a3-01d514a26170 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149534 Jul 19 12:56:12.342715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 730/1600] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:12 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:12.871470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:12.872028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:12.878491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:12.878939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:12.879694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:12.880127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:12.943170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:12.950918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04293b4b-b87f-4519-b68e-9e076b58885c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083340 Jul 19 12:56:12.951487 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 871/1601] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:12 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:13.359635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:13.360272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:13.366741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:13.367196 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:13.367962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:13.368439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:13.494308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:13.502191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6e2c34d7-b9a0-4605-85d7-d74a11e34a93 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146506 Jul 19 12:56:13.502756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 731/1602] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:13 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:13.968428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:13.969022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:13.976688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:13.977293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:13.978073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:13.978515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:14.039529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:14.047466 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4d3432c3-095d-4ccb-a094-c9b14b5ce1f1 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.083266 Jul 19 12:56:14.048027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 872/1603] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:13 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:14.521670 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:14.522283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:14.528697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:14.529144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:14.529901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:14.530336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:14.659389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:14.667218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-22822829-acd6-4692-a419-4bfc16e8bda2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149846 Jul 19 12:56:14.667860 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 732/1604] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:14 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:15.065078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:15.065688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:15.072690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:15.073140 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:15.073895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:15.074326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:15.136030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:15.144054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6bd1c180-1eb0-4b14-80d3-7ae557842728 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.082855 Jul 19 12:56:15.144859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 873/1605] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:15 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:15.684343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:15.684955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:15.691638 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:15.692090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:15.692961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:15.693403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:15.818416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:15.826364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d66c2c10-4659-4923-8313-33cdb5e45d69 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145890 Jul 19 12:56:15.826941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 733/1606] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:15 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:16.160247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:16.160864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:16.167408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:16.167860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:16.168651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:16.169092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:16.233417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:16.235645 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:16.242609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-48020be2-dab8-42f8-8198-d8b7df70047e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.086252 Jul 19 12:56:16.243167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 874/1607] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:16 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:16.843950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:16.844585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:16.851527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:16.851981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:16.852770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:16.853206 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:16.977993 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:16.985781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-deb903c3-1333-44a9-8f39-fca4b25bda5d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.145724 Jul 19 12:56:16.986353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 734/1608] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:16 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:17.259096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:17.259701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:17.266635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:17.267109 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:17.267862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:17.268323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:17.328141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:17.336640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e89641ca-a5c6-43db-b4d4-7611e2a8a6d8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081406 Jul 19 12:56:17.337213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 875/1609] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:17 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:18.003379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:18.004646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:18.011267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:18.011721 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:18.012523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:18.012960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:18.141356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:18.149406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-115f0844-69c8-4532-b154-6a235c845db5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149736 Jul 19 12:56:18.149981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 735/1610] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:17 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:18.353657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:18.354193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:18.360585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:18.361035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:18.361790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:18.362221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:18.422831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:18.431375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e844baa4-7d48-4664-857f-f59ac6d582eb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.081626 Jul 19 12:56:18.432410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 876/1611] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:18 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:19.166822 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:19.167503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:19.174107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:19.174571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:19.175371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:19.175825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:19.179907 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:19.306212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:19.314066 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2db1e857-1609-489d-8e1b-b2aed911b90e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151095 Jul 19 12:56:19.314628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 736/1612] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:19 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:19.448267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:19.448806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:19.455227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:19.455680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:19.456467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:19.456906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:19.529286 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:19.537230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e582c3a4-fc9e-4b2c-be30-761a51ee194f tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.092891 Jul 19 12:56:19.537795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 877/1613] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:19 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:20.330945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:20.331590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:20.338572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:20.339025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:20.339813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:20.340283 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:20.470659 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:20.479125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-64dfb2e3-7cd8-4816-a67f-4477e759022a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152067 Jul 19 12:56:20.479690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 737/1614] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:20 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:20.554246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:20.555356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:20.563050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:20.563503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:20.564349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:20.564790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:20.632525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:20.640400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f3fde2d8-0fa2-4d0f-999b-65ecff0ae2db tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.091021 Jul 19 12:56:20.641213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 878/1615] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:20 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:21.496060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:21.496710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:21.503086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:21.504023 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:21.504806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:21.505237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:21.634902 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:21.642923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f3216907-fc5a-49da-8531-7c7e80dafea1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150739 Jul 19 12:56:21.643478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 738/1616] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:21 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:21.656916 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:21.657521 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:21.663816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:21.664293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:21.665052 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:21.665484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:21.725215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:21.732982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2416fc30-9f08-4e6c-a33d-f8cbebf0b76d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.079880 Jul 19 12:56:21.733554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 879/1617] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:21 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:22.661626 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:22.662246 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:22.668845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:22.669305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:22.670073 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:22.670519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:22.749771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:22.750499 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:22.757098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:22.757547 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:22.758312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:22.758747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:22.807129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:22.815005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f12ec5ec-da26-40c3-871c-599ee6e4ba25 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.157939 Jul 19 12:56:22.815575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 739/1618] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:22 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:22.823208 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:22.831139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-434c2fec-2861-4d0d-8c74-005d7a1870f9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.085305 Jul 19 12:56:22.832313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 880/1619] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:22 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:23.832829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:23.833445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:23.839884 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:23.840385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:23.841147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:23.841590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:23.848557 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:23.849175 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:23.855492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:23.855944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:23.856737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:23.857170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:23.939864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:23.947665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5237eb2a-74ba-43d9-9023-b147a67f2d5c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 200 len: 1371 microversion: 2.1 time: 0.103515 Jul 19 12:56:23.948392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 881/1620] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:23 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:23.964479 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b11d3d85-b1ff-45aa-a581-5944d47dc58d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '.version_select at 0x7fd9981ee430>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:23.986413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b11d3d85-b1ff-45aa-a581-5944d47dc58d tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526115753" status: 202 len: 0 microversion: 2.1 time: 0.025508 Jul 19 12:56:23.987005 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 882/1621] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jul 19 12:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526115753 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 12:56:24.001315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:24.009765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ff4c8e39-4d79-4802-b0fb-001a8c3731d7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.180740 Jul 19 12:56:24.010430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 740/1622] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:23 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:24.759821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b75ddab1-c62d-474d-bd4d-f255a54395c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: .version_select at 0x7fd99828a0d0>, body: {"keypair": {"name": "tempest-keypair-1516375121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvoqJ2C4Sh1f58NMSEzrFmUIHdRhx54l4jWfxFYhWOx0etOzBSOmkUWt6/sOKYeaNvpl+s0aYVhvzWHnH19vN9V/o0vDwAKkbtwP8hSdn5dG953gsAM84/qVe1+Ze+VoA=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:56:24.778094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-b75ddab1-c62d-474d-bd4d-f255a54395c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:56:24.781956 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-b75ddab1-c62d-474d-bd4d-f255a54395c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:56:24.804801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b75ddab1-c62d-474d-bd4d-f255a54395c4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048933 Jul 19 12:56:24.809838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 883/1623] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 12:56:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:56:25.027025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:25.027656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:25.033873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:25.034332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:25.036367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:25.036804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:25.215112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:25.223222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2a3efdbd-c210-4ac7-ac1b-a97fb423bdec tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.200005 Jul 19 12:56:25.224058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 741/1624] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:25 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:26.165107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1171511926", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbcf9e05-75a4-4a6f-9f4c-53034463b4ca"}], "security_groups": [{"name": "tempest-securitygroup--663068216"}], "key_name": "tempest-keypair-1516375121", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:56:26.240913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:26.241593 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:26.250759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:26.251219 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:26.252002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:26.252467 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:26.270779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] validate_networks() for [('dbcf9e05-75a4-4a6f-9f4c-53034463b4ca', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:56:26.464726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:26.473561 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cb6d973c-67ee-42de-a1b8-c28cd1702e15 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.235900 Jul 19 12:56:26.474135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 742/1625] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:26 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:56:26.705188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:56:26.705675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:56:26.706149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:56:26.707277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:56:26.707706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:56:26.716589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:26.717092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:26.718396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:26.718847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:26.735597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:56:26.740036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:56:26.751148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:56:26.753963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:56:26.800062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-65f716c8-3a45-42cc-8894-97c5af2f3e70 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.640192 Jul 19 12:56:26.800765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 884/1626] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:56:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:56:26.810683 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2fdcb17c-6dc4-4dac-b3dd-55703003eca3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:26.811298 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2fdcb17c-6dc4-4dac-b3dd-55703003eca3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:26.864834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2fdcb17c-6dc4-4dac-b3dd-55703003eca3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:26.871443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2fdcb17c-6dc4-4dac-b3dd-55703003eca3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1242 microversion: 2.1 time: 0.064648 Jul 19 12:56:26.872034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 743/1627] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:26 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:27.491887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:27.492526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:27.499330 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:27.499785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:27.500586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:27.501089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:27.633070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:27.641359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e83a464e-0c8a-42f5-b447-54afec06a6af tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.154188 Jul 19 12:56:27.641937 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 885/1628] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:27 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:27.887869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:27.888715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:27.896697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:27.897233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:27.898075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:27.898621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:27.966676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:27.974518 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-546e1d3e-5e12-40ac-b0dd-b77e488af720 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1300 microversion: 2.1 time: 0.090459 Jul 19 12:56:27.975091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 744/1629] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:27 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:28.658884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:28.659497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:28.661915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:28.667796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:28.668252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:28.669041 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:28.669477 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:28.935355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:28.943253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad1ceee2-6503-4cab-a1cc-9caf110ba95b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.288246 Jul 19 12:56:28.943827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 886/1630] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:28 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:28.992205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:28.992840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:28.999278 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:28.999744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:29.000550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:29.000995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:29.230833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:29.238526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dbab9b7f-09f6-456b-92da-fb06be69e333 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1367 microversion: 2.1 time: 0.251135 Jul 19 12:56:29.239174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 745/1631] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:28 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:29.502492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-26f959a0-f610-418e-87ae-bd1c463ab7d6 req-f75d188e-6719-4999-84f8-ce7ee9194717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439906e0-742e-40df-bd40-7b2bee31fed8", "tag": "3269cb0c-458f-46fc-ad87-eec07e0a7e14"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:56:29.519195 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-26f959a0-f610-418e-87ae-bd1c463ab7d6 req-f75d188e-6719-4999-84f8-ce7ee9194717 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:29.519757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-26f959a0-f610-418e-87ae-bd1c463ab7d6 req-f75d188e-6719-4999-84f8-ce7ee9194717 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:29.531398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-26f959a0-f610-418e-87ae-bd1c463ab7d6 req-f75d188e-6719-4999-84f8-ce7ee9194717 service nova] Creating event network-changed:3269cb0c-458f-46fc-ad87-eec07e0a7e14 for instance 439906e0-742e-40df-bd40-7b2bee31fed8 on hv-cinder-82099 Jul 19 12:56:29.537161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-26f959a0-f610-418e-87ae-bd1c463ab7d6 req-f75d188e-6719-4999-84f8-ce7ee9194717 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121487 Jul 19 12:56:29.537919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 887/1632] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:56:29.961110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:29.961606 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:29.967651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:29.968084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:29.968897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:29.969337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:30.101157 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:30.108852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8bc5176a-0406-4d51-9f29-96afff5a77b2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152385 Jul 19 12:56:30.109425 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 746/1633] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:29 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:30.255447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:30.256139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:30.262234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:30.262683 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:30.263440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:30.263872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:30.391377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:30.399811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-202b62db-9fc9-4792-9a75-b424fe41dc7a tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1367 microversion: 2.1 time: 0.148873 Jul 19 12:56:30.400449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 888/1634] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:30 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:31.125716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:31.126328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:31.132816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:31.133267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:31.134020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:31.134449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:31.260964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:31.269716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-51c20ead-78ff-4e4b-b3ee-c721e13b297e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147722 Jul 19 12:56:31.270303 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 747/1635] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:31 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:31.416471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:31.417081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:31.423664 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:31.424054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:31.424848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:31.425928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:31.557305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:31.564683 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-03aa7378-96b8-4525-8f75-afc622208339 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1367 microversion: 2.1 time: 0.152079 Jul 19 12:56:31.565251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 889/1636] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:31 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:32.287710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:32.288348 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:32.290676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=56 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:32.295925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:32.296412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:32.297175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:32.297611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:32.422112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:32.430603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-17e42421-0753-4205-ba29-605c2028e3bd tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147180 Jul 19 12:56:32.431617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 748/1637] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:32 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:32.580990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:32.581603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:32.588631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:32.589078 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:32.589839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:32.590273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:32.722280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:32.729711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d1f4b6f4-8832-4b59-81b6-0ad4375fb57e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1367 microversion: 2.1 time: 0.152499 Jul 19 12:56:32.730274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 890/1638] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:32 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:33.448000 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:33.448644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:33.455159 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:33.455613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:33.456410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:33.456853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:33.585582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:33.593497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-af50fcb3-c4eb-4721-ad83-df4f71b0094f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149343 Jul 19 12:56:33.594070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 749/1639] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:33 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:33.746079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:33.746687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:33.753147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:33.753602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:33.754364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:33.754801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:33.881934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:33.889185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-67ab7448-1d5b-4dd1-bf51-3d7334a01e40 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1367 microversion: 2.1 time: 0.146949 Jul 19 12:56:33.889746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 891/1640] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:33 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:34.576995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-e7028c9a-0bfb-45c0-a7ed-50b2f4e91dca req-c4290096-15e1-4137-b029-5a2881ba1bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439906e0-742e-40df-bd40-7b2bee31fed8", "name": "network-vif-plugged", "status": "completed", "tag": "3269cb0c-458f-46fc-ad87-eec07e0a7e14"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:56:34.585635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-e7028c9a-0bfb-45c0-a7ed-50b2f4e91dca req-c4290096-15e1-4137-b029-5a2881ba1bec service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:34.586083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-e7028c9a-0bfb-45c0-a7ed-50b2f4e91dca req-c4290096-15e1-4137-b029-5a2881ba1bec service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:34.597239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-e7028c9a-0bfb-45c0-a7ed-50b2f4e91dca req-c4290096-15e1-4137-b029-5a2881ba1bec service nova] Creating event network-vif-plugged:3269cb0c-458f-46fc-ad87-eec07e0a7e14 for instance 439906e0-742e-40df-bd40-7b2bee31fed8 on hv-cinder-82099 Jul 19 12:56:34.602248 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-e7028c9a-0bfb-45c0-a7ed-50b2f4e91dca req-c4290096-15e1-4137-b029-5a2881ba1bec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028900 Jul 19 12:56:34.603078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 750/1641] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:56:34.610798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:34.611416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:34.619290 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:34.619995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:34.620806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:34.621246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:34.763081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:34.772159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-01b90b6a-5e0f-44fe-801a-f778c0b48579 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.165211 Jul 19 12:56:34.772960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 892/1642] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:34 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:34.906359 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:34.907097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:34.913868 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:34.914350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:34.915118 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:34.915563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:35.041221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:35.048826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3e0bf1cd-5d0e-4efa-8bc7-bb006263abf2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1367 microversion: 2.1 time: 0.146640 Jul 19 12:56:35.049403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 751/1643] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:34 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:35.790027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:35.790597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:35.796989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:35.797441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:35.798202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:35.798658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:35.927787 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:35.935552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d42c52f4-f28b-44c1-93b9-7e373da97b8d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150096 Jul 19 12:56:35.936113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 893/1644] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:35 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:36.066255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:36.066863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:36.073645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:36.074100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:36.074868 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:36.075310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:36.205740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:36.213547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fb05c647-975f-4f0b-98d7-6c896dbafca5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1367 microversion: 2.1 time: 0.151284 Jul 19 12:56:36.214119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 752/1645] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:36 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:36.952493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:36.953126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:36.955067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:36.955764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=10 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:36.961973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:36.962416 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:36.963167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:36.963598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:37.091850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:37.094512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:37.104899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af66a48c-21e0-4d48-a9e4-b3b7b7f5dd61 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.156300 Jul 19 12:56:37.105475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 894/1646] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:36 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:37.229697 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:37.230299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:37.232344 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:37.238017 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:37.238469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:37.239866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:37.240325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:37.364481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:37.371780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f82937b7-53cf-43e9-bc71-bc7cbdbaba2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1557 microversion: 2.1 time: 0.145920 Jul 19 12:56:37.372372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 753/1647] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:37 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:37.387597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc4f3cc6-39df-4031-a822-c328c10876a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:37.388100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc4f3cc6-39df-4031-a822-c328c10876a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:37.394314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4f3cc6-39df-4031-a822-c328c10876a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:37.394766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4f3cc6-39df-4031-a822-c328c10876a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:37.396037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4f3cc6-39df-4031-a822-c328c10876a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:37.396513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4f3cc6-39df-4031-a822-c328c10876a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:37.471534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc4f3cc6-39df-4031-a822-c328c10876a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087720 Jul 19 12:56:37.472192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 895/1648] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jul 19 12:56:37 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:56:38.123255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:38.123788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:38.130181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:38.130638 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:38.131404 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:38.131840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:38.147646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:38.317984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:38.325808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f4f1b6af-dd93-41fc-a4de-7417c1735e0c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.206514 Jul 19 12:56:38.326379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 754/1649] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:38 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:38.459682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-b97842b3-581e-4d65-bca3-71e7bfcda672 req-f2116905-4192-44d6-9247-23e487bdbcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439906e0-742e-40df-bd40-7b2bee31fed8", "tag": "3269cb0c-458f-46fc-ad87-eec07e0a7e14"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:56:38.467706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b97842b3-581e-4d65-bca3-71e7bfcda672 req-f2116905-4192-44d6-9247-23e487bdbcd8 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:38.468290 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b97842b3-581e-4d65-bca3-71e7bfcda672 req-f2116905-4192-44d6-9247-23e487bdbcd8 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:38.479170 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-b97842b3-581e-4d65-bca3-71e7bfcda672 req-f2116905-4192-44d6-9247-23e487bdbcd8 service nova] Creating event network-changed:3269cb0c-458f-46fc-ad87-eec07e0a7e14 for instance 439906e0-742e-40df-bd40-7b2bee31fed8 on hv-cinder-82099 Jul 19 12:56:38.484283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-b97842b3-581e-4d65-bca3-71e7bfcda672 req-f2116905-4192-44d6-9247-23e487bdbcd8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028803 Jul 19 12:56:38.484899 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 896/1650] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:56:39.342182 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:39.343453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:39.350803 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:39.351265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:39.352050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:39.352537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:39.488097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:39.496281 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a0ae3812-3302-4dec-88bd-06eb38cd4325 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.157976 Jul 19 12:56:39.496849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 755/1651] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:39 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:40.515192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:40.516168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:40.522400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:40.522853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:40.523623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:40.524061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:40.651816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:40.659728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-69ff1385-bd90-46ad-a910-f84bbd0aafa5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149333 Jul 19 12:56:40.660251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 897/1652] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:40 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:41.676885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:41.677548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:41.684361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:41.684822 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:41.685733 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:41.686184 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:41.814502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:41.822957 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ed9a5ad6-bde7-462e-bbf3-8cdbeb603136 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149960 Jul 19 12:56:41.823529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 756/1653] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:41 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:42.839699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:42.840340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:42.846757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:42.847202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:42.847954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:42.848419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:42.974601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:42.982375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d8affb5-d6e7-4556-ad8d-26d14a1c50d9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146583 Jul 19 12:56:42.982934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 898/1654] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:42 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:43.999679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:44.000331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:44.006750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:44.007202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:44.007964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:44.008428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:44.133866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:44.141933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f58b2eec-3f2a-4f66-9977-ae419f92ec4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.146105 Jul 19 12:56:44.142496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 757/1655] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:43 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:45.159440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:45.160047 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:45.166741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:45.167190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:45.167949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:45.168413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:45.298867 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:45.307498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6d352d04-aa8c-4a54-95f6-9afbd7892487 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151968 Jul 19 12:56:45.308066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 899/1656] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:45 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:46.324476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:46.325099 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:46.331572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:46.332026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:46.333418 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:46.333859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:46.463227 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:46.471085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-98a3beda-ddbf-42c7-bb3c-193049260165 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.150476 Jul 19 12:56:46.471650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 758/1657] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:46 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:47.488472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:47.489580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:47.496116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:47.496597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:47.497362 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:47.497800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:47.628971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:47.637342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-108a4d12-793f-4cc0-8a4b-a80bc0ee3908 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152797 Jul 19 12:56:47.637917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 900/1658] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:47 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:48.654633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:48.655241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:48.661783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:48.662236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:48.663005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:48.663431 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:48.791059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:48.799162 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-622db3d4-5348-4c0c-8fb9-1770134e0b2c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148354 Jul 19 12:56:48.799729 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 759/1659] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:48 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:49.816749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:49.817354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:49.823827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:49.824309 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:49.825069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:49.825501 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:49.949511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:49.957501 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e782b14a-2336-45df-aa6c-1aeab71ef0cf tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.144625 Jul 19 12:56:49.958067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 901/1660] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:49 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:50.974371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:50.974986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:50.981546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:50.982002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:50.982768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:50.983235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:51.114607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:51.122412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4c46d024-d8a4-4507-81d0-6cc5157d1020 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.151899 Jul 19 12:56:51.123008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 760/1661] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:50 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:52.140038 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:52.140732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:52.147601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:52.148057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:52.148864 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:52.149304 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:52.277866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:52.286277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-141d0470-e588-49ed-a632-983b1ab66ce3 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149541 Jul 19 12:56:52.286845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 902/1662] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:52 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:53.303694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:53.304328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:53.310819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:53.311268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:53.312026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:53.312482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:53.440644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:53.449096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ab6c31a1-b1e0-42c4-ac05-485e45420f42 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.149728 Jul 19 12:56:53.449665 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 761/1663] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:53 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:54.466220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:54.466815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:54.473288 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:54.473741 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:54.474557 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:54.474995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:54.601520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:54.609812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-044add07-b0e7-47d6-b329-0e35bcbc7395 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147469 Jul 19 12:56:54.610577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 903/1664] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:54 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:55.626878 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:55.627493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:55.633627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:55.634082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:55.634848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:55.635288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:55.766866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:55.775480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a2b7ab69-8cac-4617-b392-ea8950b885df tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152648 Jul 19 12:56:55.776048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 762/1665] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:55 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:56.793283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:56.793968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:56.800534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:56.800993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:56.801767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:56.802831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:56.930480 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:56.938272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4df47d7e-8515-4afc-bdf2-fc016045e3a4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148835 Jul 19 12:56:56.938832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 904/1666] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:56 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:57.956308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:57.956827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:57.963704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:57.964201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:57.964967 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:57.965403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:58.092030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:58.099815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-aaf0dd95-6cd8-4b16-8274-1073c96adc7d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.147444 Jul 19 12:56:58.100413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 763/1667] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:57 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:56:59.117346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:56:59.117947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:56:59.120451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=38 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:59.125692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:59.126139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:59.126895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:56:59.127327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:56:59.257101 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:56:59.265001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50442c3c-875c-48b8-83e8-83dd877bbec5 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.152169 Jul 19 12:56:59.265563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 905/1668] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:56:59 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:00.282877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:00.283505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:00.290654 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:00.291114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:00.291885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:00.292364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:00.419218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:00.427681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9b51a67b-2fb1-4145-a6f5-a2ca0b302e02 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148039 Jul 19 12:57:00.428271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 764/1669] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:00 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:01.444252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:01.444884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:01.451238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:01.451686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:01.452488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:01.452922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:01.580743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:01.589111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36290484-417e-4df7-8802-d21c0fde1aca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148715 Jul 19 12:57:01.589669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 906/1670] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:01 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:02.606437 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:02.607078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:02.609474 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=34 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:57:02.614713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:02.615832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:02.616629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:02.617070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:02.742848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:02.750599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-529a8841-110f-409c-9e60-495a66b4cf43 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.148060 Jul 19 12:57:02.751168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 765/1671] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:02 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:03.766980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:03.767591 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:03.774043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:03.774496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:03.775263 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:03.775699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:03.898839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:03.906686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bfb59cb5-5e35-4c5f-8aef-0cb412349856 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.143817 Jul 19 12:57:03.907259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 907/1672] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:03 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:04.923709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:04.924254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:04.930721 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:04.931186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:04.931934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:04.932403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:05.070468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:05.078430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6f7c2beb-ad00-4501-83c2-9b6c0f1ed922 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1559 microversion: 2.1 time: 0.158628 Jul 19 12:57:05.079008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 766/1673] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:04 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:05.854221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-e60cdf5e-01b7-4af3-bf06-3c7cd0c7711d req-52cdf681-3d5c-4f47-8969-d456d01d5e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadeb57a-3504-4bac-86e9-e8ef951da265", "name": "network-vif-deleted", "tag": "51c9b6a8-1f48-4884-9961-b7202894f711"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:57:05.862340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e60cdf5e-01b7-4af3-bf06-3c7cd0c7711d req-52cdf681-3d5c-4f47-8969-d456d01d5e82 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:05.862776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e60cdf5e-01b7-4af3-bf06-3c7cd0c7711d req-52cdf681-3d5c-4f47-8969-d456d01d5e82 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:05.874605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-e60cdf5e-01b7-4af3-bf06-3c7cd0c7711d req-52cdf681-3d5c-4f47-8969-d456d01d5e82 service nova] Creating event network-vif-deleted:51c9b6a8-1f48-4884-9961-b7202894f711 for instance cadeb57a-3504-4bac-86e9-e8ef951da265 on hv-cinder-82099 Jul 19 12:57:05.879420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-e60cdf5e-01b7-4af3-bf06-3c7cd0c7711d req-52cdf681-3d5c-4f47-8969-d456d01d5e82 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086542 Jul 19 12:57:05.880015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 908/1674] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:57:06.096142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:06.096849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:06.104101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:06.104588 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:06.105356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:06.105795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:06.169259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:06.177087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e147b9bd-7875-47d8-ae55-6a32099b1768 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084792 Jul 19 12:57:06.177839 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 767/1675] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:06 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:07.195352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:07.196054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:07.202541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:07.202993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:07.203762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:07.204224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:07.206871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=76 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:57:07.265473 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:07.273475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aeb1dd83-9ca8-4947-848e-3eb53b78c0f1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082885 Jul 19 12:57:07.274032 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 909/1676] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:07 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:08.290572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:08.291196 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:08.297752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:08.298211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:08.298983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:08.299427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:08.301976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=82 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:57:08.362984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:08.371432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0d9417b6-c42b-45c5-a212-85cf896f2b4e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084770 Jul 19 12:57:08.371998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 768/1677] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:08 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:09.388957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:09.389604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:09.397028 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:09.397474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:09.398229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:09.398657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:09.457656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:09.466189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c6b9843-b550-4940-b436-eb06c67c00ca tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081035 Jul 19 12:57:09.466761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 910/1678] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:09 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:10.483025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:10.483633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:10.490329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:10.490784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:10.491544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:10.491979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:10.553078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:10.560862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4361764b-b5c1-4c15-b439-31d7b775d7c1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081668 Jul 19 12:57:10.561423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 769/1679] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:10 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:11.577797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:11.578439 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:11.584967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:11.585422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:11.586188 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:11.586628 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:11.649244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:11.657204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f754a3eb-54ad-4a2b-a92f-b4ba50b706be tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083336 Jul 19 12:57:11.657769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 911/1680] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:11 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:12.674465 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:12.675086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:12.681636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:12.682088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:12.682850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:12.683287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:12.745446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:12.753256 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c643a640-c55f-40a1-941f-91604114c1e7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082632 Jul 19 12:57:12.753828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 770/1681] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:12 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:13.770587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:13.771241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:13.777770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:13.778216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:13.778982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:13.779419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:13.841797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:13.850266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38fec505-748a-4b1d-acd2-550a1939aa9b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083778 Jul 19 12:57:13.850839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 912/1682] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:13 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:14.647486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-54504c60-6fb9-49e3-9afc-93855294fdd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:14.647990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-54504c60-6fb9-49e3-9afc-93855294fdd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:14.654491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-54504c60-6fb9-49e3-9afc-93855294fdd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:14.654964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-54504c60-6fb9-49e3-9afc-93855294fdd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:14.655728 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-54504c60-6fb9-49e3-9afc-93855294fdd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:14.656166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-54504c60-6fb9-49e3-9afc-93855294fdd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:14.678175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-54504c60-6fb9-49e3-9afc-93855294fdd3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8/ips" status: 200 len: 150 microversion: 2.1 time: 0.035129 Jul 19 12:57:14.678744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 771/1683] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:57:14 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:57:14.867737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:14.868293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:14.874958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:14.875420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:14.876204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:14.876640 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:14.936356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:14.945030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3bbe62a8-ae32-4aed-8a7d-b69316324328 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081775 Jul 19 12:57:14.945594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 913/1684] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:14 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:15.963147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:15.963694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:15.970035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:15.970487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:15.971241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:15.971672 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:16.034403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:16.042724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c837b72f-419a-4a0e-895d-6e91035b028a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084218 Jul 19 12:57:16.043282 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 772/1685] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:15 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:17.059613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:17.060247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:17.066674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:17.067124 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:17.068414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:17.068849 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:17.131703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:17.139543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c15429c2-5b56-42ff-ac7b-3523476943f8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083847 Jul 19 12:57:17.140095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 914/1686] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:17 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:18.156605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:18.157226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:18.164531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:18.164984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:18.165746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:18.166181 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:18.461886 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:18.469861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b0ee1895-3e04-41a6-aac7-5c6102ec0b3e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.317116 Jul 19 12:57:18.470420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 773/1687] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:18 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:57:19.486239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:19.486854 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:19.493469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:19.493921 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:19.494689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:19.495130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:19.555461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:19.563241 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-73ef801a-df27-4459-be5b-6fa990cca952 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080886 Jul 19 12:57:19.563803 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 915/1688] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:19 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:20.580117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:20.580784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:20.587217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:20.587669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:20.588457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:20.588897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:20.802948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:20.810992 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3c8b6bc3-b8c5-47a7-a882-2bbe249a1715 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.234684 Jul 19 12:57:20.811555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 774/1689] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:20 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:21.828119 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:21.828766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:21.835203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:21.835650 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:21.836435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:21.836870 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:21.896328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:21.904957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da5ad0f4-7729-4253-b89c-b734f43acedc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080701 Jul 19 12:57:21.905513 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 916/1690] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:21 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:22.922090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:22.922635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:22.929126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:22.929579 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:22.930327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:22.930762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:22.993379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:23.001133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d14679d5-dd31-47cd-a8b4-375c6297d40e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082963 Jul 19 12:57:23.001696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 775/1691] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:22 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:24.018973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:24.019587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:24.026502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:24.026952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:24.027747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:24.028202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:24.090142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:24.097880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5afc1619-d00a-4642-bce4-65c960968559 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083068 Jul 19 12:57:24.098438 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 917/1692] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:24 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:25.115380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:25.115991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:25.122153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:25.122638 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:25.123427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:25.123866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:25.183505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:25.191220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-caac63ac-ad7e-4d77-afb3-e5320ba89853 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.079651 Jul 19 12:57:25.191770 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 776/1693] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:25 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:26.208587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:26.209178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:26.215794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:26.216267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:26.217030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:26.217459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:26.277556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:26.285274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0b93ade-049d-4d86-a571-4cba19d1c100 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080535 Jul 19 12:57:26.285838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 918/1694] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:26 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:27.302580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:27.303738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:27.310154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:27.310599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:27.311352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:27.311785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:27.374293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:27.382112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1d43d8e3-00f3-491f-968f-7b2934031c9d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083373 Jul 19 12:57:27.382671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 777/1695] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:27 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:28.399747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:28.400384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:28.406915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:28.407358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:28.408118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:28.408577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:28.469518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:28.477982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8e7f5ed-d351-40cc-933d-e363621c0d9a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082666 Jul 19 12:57:28.478550 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 919/1696] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:28 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:29.494520 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:29.495142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:29.501527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:29.501985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:29.502746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:29.503183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:29.563383 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:29.571275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b90123ed-dab3-4a77-853b-b59e33916225 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081215 Jul 19 12:57:29.571827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 778/1697] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:29 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:30.589004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:30.589622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:30.592039 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=30 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:57:30.597367 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:30.597821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:30.598586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:30.599025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:30.659808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:30.667701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e728f16c-1d17-415c-89cf-f3d3a2b0af28 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083301 Jul 19 12:57:30.668220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 920/1698] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:30 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:31.684743 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:31.685563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:31.692293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:31.692756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:31.693525 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:31.694582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:31.758431 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:31.766641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3c04bade-231d-4ec5-b49f-a0467f5c3e40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.085413 Jul 19 12:57:31.767202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 779/1699] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:31 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:32.783299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:32.783909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:32.790431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:32.790883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:32.791649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:32.792089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:32.851509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:32.859459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6061158-60d0-47be-bf89-732e9826968c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080016 Jul 19 12:57:32.860022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 921/1700] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:32 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:33.876629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:33.877239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:33.879564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=30 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:57:33.884937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:33.885389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:33.886145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:33.886576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:33.948355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:33.955973 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-713fafaf-e85d-41a5-a997-f2075877d176 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083167 Jul 19 12:57:33.956562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 780/1701] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:33 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:34.974202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:34.974761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:34.981748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:34.982201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:34.982963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:34.983399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:35.043353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:35.051327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-104b9fe4-71be-4c57-8f3b-debc3c328929 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081125 Jul 19 12:57:35.051890 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 922/1702] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:34 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:35.172831 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:57:35.173336 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:57:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:57:36.069308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:36.070607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:36.077164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:36.077614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:36.078376 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:36.078809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:36.141531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:36.149858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-841c9c10-07cc-40fd-8636-9fccde8992a8 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084497 Jul 19 12:57:36.150415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 781/1703] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:36 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:37.166184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:37.166850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:37.173365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:37.173819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:37.174579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:37.175016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:37.235004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:37.237180 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=88 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:57:37.243955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bcdfcf12-41db-4921-aa72-c750978cc62a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081681 Jul 19 12:57:37.244542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 923/1704] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:37 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:38.261027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:38.261620 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:38.268658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:38.269109 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:38.269870 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:38.270306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:38.329591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:38.332038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=86 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:57:38.339291 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c2677305-fcfb-4ebd-a4a2-46b61dd59ae6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082483 Jul 19 12:57:38.339852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 782/1705] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:38 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:39.356625 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:39.357228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:39.363819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:39.364297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:39.365066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:39.365501 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:39.427759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:39.436386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d17c05a4-c714-40a8-9507-c6b6e8f1da83 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083666 Jul 19 12:57:39.436952 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 924/1706] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:39 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:40.453149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:40.453787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:40.460358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:40.460815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:40.461568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:40.462003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:40.524374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:40.532257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-82e89efd-7333-4400-9b6d-7fe2127ec2de tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082957 Jul 19 12:57:40.532817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 783/1707] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:40 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:41.549252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:41.549861 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:41.556512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:41.556960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:41.557753 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:41.558191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:41.618365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:41.626532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9e24575-581f-4196-bffa-d7d54bcac9fa tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081153 Jul 19 12:57:41.627098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 925/1708] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:41 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:42.644061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:42.644722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:42.651717 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:42.652169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:42.652952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:42.653398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:42.713022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:42.720885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-81a2fb99-a2d6-491b-95e4-eb800082bb78 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080919 Jul 19 12:57:42.721455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 784/1709] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:42 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:43.738407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:43.739051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:43.746833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:43.747283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:43.748046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:43.748511 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:43.809121 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:43.816986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0a404550-d829-4e84-afd1-16c42d1d6f95 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082438 Jul 19 12:57:43.817559 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 926/1710] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:43 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:44.834210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:44.834748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:44.841277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:44.841732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:44.842508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:44.842950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:44.912049 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:44.919856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-af6920e3-d6b3-46e5-8466-0ec42e351be9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.089571 Jul 19 12:57:44.920443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 785/1711] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:44 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:45.937031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:45.937581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:45.943980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:45.944965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:45.945723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:45.946177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:46.008929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:46.017145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-66982045-c286-4941-aa62-710beca724fe tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084006 Jul 19 12:57:46.017715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 927/1712] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:45 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:47.034756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:47.035396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:47.042330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:47.042781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:47.043549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:47.043987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:47.106750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:47.114668 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-860e2a32-6522-4cb5-b535-6504fde5874e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083782 Jul 19 12:57:47.115228 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 786/1713] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:47 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:48.130759 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:48.131497 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:48.138522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:48.138974 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:48.139735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:48.140172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:48.199770 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:48.207508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa4c381f-d9df-47e6-ad64-9fe4803ccccc tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080599 Jul 19 12:57:48.208073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 928/1714] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:48 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:49.223569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:49.224206 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:49.230657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:49.231105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:49.231865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:49.232331 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:49.294486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:49.302238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-47ea6577-7faa-4bd4-b236-e38115968493 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082635 Jul 19 12:57:49.302798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 787/1715] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:49 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:50.319464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:50.320066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:50.326762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:50.327206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:50.327959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:50.328421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:50.387916 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:50.395922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94418560-3922-4de3-bb17-4921a174238f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080300 Jul 19 12:57:50.396507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 929/1716] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:50 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:51.413422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:51.414022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:51.420826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:51.421284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:51.422067 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:51.422505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:51.485534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:51.493639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-45a89b5d-e118-4d81-a2e6-b7d8bf96de30 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084315 Jul 19 12:57:51.494212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 788/1717] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:51 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:52.510626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:52.511242 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:52.518306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:52.518757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:52.519524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:52.519962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:52.582710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:52.590972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56312336-2aef-42e6-b338-3799c9a19ec6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084266 Jul 19 12:57:52.591531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 930/1718] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:52 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:53.608868 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:53.609389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:53.615837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:53.616926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:53.617681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:53.618116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:53.680748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:53.688469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c81c7255-7557-45a8-bf8e-6b928c388a6c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083519 Jul 19 12:57:53.689029 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 789/1719] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:53 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:54.704122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:54.704775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:54.710924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:54.711371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:54.712123 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:54.712576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:54.772470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:54.780293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f6387a72-ebb0-48f9-a572-e4b1a3f0f70d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.079983 Jul 19 12:57:54.780834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 931/1720] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:54 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:55.797168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:55.797777 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:55.804866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:55.805328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:55.806091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:55.806531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:55.865818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:55.874310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-af4c3981-9632-481a-a9db-edcc13257476 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081035 Jul 19 12:57:55.874869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 790/1721] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:55 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:56.356048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 12:57:56.356294 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 12:57:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 12:57:56.890627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:56.891173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:56.898012 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:56.898462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:56.899229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:56.899662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:56.960897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:56.968613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aaef5c29-46ba-4c8a-9ef0-1f51626101d6 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081919 Jul 19 12:57:56.969167 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 932/1722] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:56 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:57.985230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:57.985839 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:57.992304 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:57.992752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:57.993503 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:57.993937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:58.057168 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:58.065053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9320a716-5c92-4f33-b0e3-357538f9cc64 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083694 Jul 19 12:57:58.065599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 791/1723] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:57 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:57:59.081971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:57:59.082587 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:57:59.089564 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:59.090018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:59.090784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:57:59.091219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:57:59.152816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:57:59.161126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a9420ae4-be62-4409-b6a9-9cdb3a879e10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083022 Jul 19 12:57:59.161695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 933/1724] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:57:59 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:00.177660 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:00.178273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:00.184731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:00.185183 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:00.185941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:00.186379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:00.247102 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:00.255203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-60e7df81-cfaf-4332-b85d-daffc1c55ac2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081378 Jul 19 12:58:00.255758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 792/1725] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:00 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:01.272619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:01.273229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:01.275514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=28 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:58:01.280749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:01.281198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:01.281953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:01.282391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:01.342644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:01.351093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1bceb459-bfe7-446e-91c6-16084a6c4f10 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081637 Jul 19 12:58:01.351659 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 934/1726] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:01 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:02.368445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:02.368987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:02.375651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:02.376104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:02.376900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:02.377615 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:02.443779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:02.452155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bbafe279-4d32-4665-9185-83c96369d90b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.088214 Jul 19 12:58:02.452767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 793/1727] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:02 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:03.469100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:03.469714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:03.476312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:03.476764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:03.477525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:03.477960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:03.538347 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:03.546234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-81463ecd-a696-4afe-a59e-b41e1cc3384b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081028 Jul 19 12:58:03.546797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 935/1728] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:03 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:04.562837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:04.563452 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:04.566137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=28 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:58:04.572048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:04.572533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:04.573329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:04.573794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:04.633500 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:04.641295 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-419dd0a6-b7ea-4772-93dc-c384c99db3db tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082342 Jul 19 12:58:04.642104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 794/1729] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:04 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:05.658799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:05.659420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:05.666475 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:05.666927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:05.667690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:05.668128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:05.728262 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:05.736015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-543a5f6d-032b-468b-851c-9ab19d5ffd5a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081066 Jul 19 12:58:05.736613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 936/1730] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:05 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:06.753753 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:06.754827 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:06.765833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:06.766255 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:06.767307 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:06.767759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:06.837001 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:06.844877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-958a7f51-1e81-43a3-b75f-6f66abeaa552 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.095114 Jul 19 12:58:06.845440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 795/1731] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:06 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:07.861596 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:07.862210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:07.868698 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:07.869093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:07.869851 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:07.870282 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:07.932470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:07.940277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd93f150-4e70-446b-81a8-96febd9a892c tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082474 Jul 19 12:58:07.940841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 937/1732] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:07 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:08.958036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:08.958605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:08.965694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:08.966144 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:08.966943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:08.967380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:09.027642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:09.035512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-afa9bab2-a6a6-4d8c-a504-fae102ff51d2 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081509 Jul 19 12:58:09.036070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 796/1733] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:08 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:10.052335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:10.052971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:10.060020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:10.060503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:10.061258 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:10.061689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:10.064158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=86 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:58:10.122573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:10.130298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d79e6a8-100a-4249-9fe0-59afdad04513 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081869 Jul 19 12:58:10.130856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 938/1734] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:10 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:11.147402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:11.148013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:11.154427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:11.154879 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:11.155631 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:11.156064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:11.158564 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=86 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:58:11.221269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:11.229098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-43b066d8-7590-4aea-8147-245dfd509f1d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.085569 Jul 19 12:58:11.229662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 797/1735] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:11 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:12.246254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:12.246856 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:12.253191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:12.253638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:12.254399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:12.254828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:12.315556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:12.323948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8a6faf79-cb61-4962-b556-fe63b8157865 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082182 Jul 19 12:58:12.324556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 939/1736] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:12 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:13.341495 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:13.342108 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:13.348617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:13.349068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:13.349823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:13.350259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:13.410001 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:13.418560 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-59a8bc7d-5766-4205-9fee-940bab68cac9 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.081053 Jul 19 12:58:13.419127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 798/1737] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:13 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:14.435447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:14.436051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:14.442608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:14.443058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:14.443814 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:14.444277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:14.503538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:14.511362 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30934aa5-f6a0-445d-add2-bc6c637007ba tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.079761 Jul 19 12:58:14.511915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 940/1738] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:14 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:14.827609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:14.828151 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:14.834141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:14.834603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:14.835361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:14.836321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:14.860717 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Going to try to terminate instance {{(pid=118119) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 12:58:14.934844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d17c7f94-b62d-4983-b631-478e562ea929 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 204 len: 0 microversion: 2.1 time: 0.174966 Jul 19 12:58:14.935842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 799/1739] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 12:58:14 2022] DELETE /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 12:58:14.943773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:14.944429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:14.950375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:14.950827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:14.951595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:14.952048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:15.079179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:15.087043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1032c161-4406-4e25-97d6-9dd1bd0f1f4e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1682 microversion: 2.1 time: 0.147136 Jul 19 12:58:15.087606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 941/1740] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:14 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:15.529589 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:15.530284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:15.536145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:15.536616 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:15.537368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:15.537802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:15.598521 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:15.606306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6d42c137-80b9-4ed0-8d0e-44b460405d3a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.080954 Jul 19 12:58:15.606865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 800/1741] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:15 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:16.104801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:16.105386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:16.111748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:16.112230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:16.112991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:16.113422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:16.243428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:16.250947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30355fa5-8f25-4b0a-9665-7adcd6273a80 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1682 microversion: 2.1 time: 0.150626 Jul 19 12:58:16.251522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 942/1742] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:16 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:16.622801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:16.623414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:16.629756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:16.630204 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:16.630967 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:16.631406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:16.693412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:16.702501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7f66a483-1918-4d07-9dea-b0d18adc4386 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.083178 Jul 19 12:58:16.702922 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 801/1743] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:16 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:17.268210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:17.268836 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:17.274990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:17.275448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:17.276249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:17.276699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:17.337597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:17.345392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9286845d-795f-48a3-b5b8-f5be93e23b9b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 200 len: 1615 microversion: 2.1 time: 0.081285 Jul 19 12:58:17.345966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 943/1744] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:17 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 1615 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:17.371362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-01684c0a-a034-4b4b-8c0f-b7ad44757fa7 req-aff1dbc3-a659-40d1-b8ee-e0119f883010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439906e0-742e-40df-bd40-7b2bee31fed8", "name": "network-vif-deleted", "tag": "3269cb0c-458f-46fc-ad87-eec07e0a7e14"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:58:17.382658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-01684c0a-a034-4b4b-8c0f-b7ad44757fa7 req-aff1dbc3-a659-40d1-b8ee-e0119f883010 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:17.383714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-01684c0a-a034-4b4b-8c0f-b7ad44757fa7 req-aff1dbc3-a659-40d1-b8ee-e0119f883010 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:17.396758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-01684c0a-a034-4b4b-8c0f-b7ad44757fa7 req-aff1dbc3-a659-40d1-b8ee-e0119f883010 service nova] Creating event network-vif-deleted:3269cb0c-458f-46fc-ad87-eec07e0a7e14 for instance 439906e0-742e-40df-bd40-7b2bee31fed8 on hv-cinder-82099 Jul 19 12:58:17.404420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-01684c0a-a034-4b4b-8c0f-b7ad44757fa7 req-aff1dbc3-a659-40d1-b8ee-e0119f883010 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037853 Jul 19 12:58:17.405117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 802/1745] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:58:17.720345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:17.720888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:17.727638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:17.728089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:17.728908 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:17.729344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:17.798372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:17.806647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-586e3897-f17f-4f33-8a17-1c1d2041f00b tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.090326 Jul 19 12:58:17.807231 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 944/1746] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:17 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:18.362125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:18.362736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:18.369343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:18.369796 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:18.370548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:18.370981 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:18.387043 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 HTTP/1.1 Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 12:58:18.388767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 12:58:18.390607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '439906e0-742e-40df-bd40-7b2bee31fed8'} Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 12:58:18.391797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 12:58:18.393273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 12:58:18.394508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 12:58:18.394508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b76b024b-9918-4734-be3f-7dd9e55adf64 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 404 len: 111 microversion: 2.1 time: 0.032371 Jul 19 12:58:18.394508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 803/1747] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:18 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 12:58:18.401540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e85958aa-7f11-4b4b-bf3c-813393af53a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '.version_select at 0x7fd99830aaf0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:18.422577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e85958aa-7f11-4b4b-bf3c-813393af53a4 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516375121" status: 202 len: 0 microversion: 2.1 time: 0.026088 Jul 19 12:58:18.423069 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 945/1748] 10.222.0.13 () {58 vars in 1220 bytes} [Tue Jul 19 12:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516375121 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 12:58:18.824941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:18.825551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:18.831422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:18.831872 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:18.832681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:18.833124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:18.899948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:18.907986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dc34ffe3-c246-481e-a622-18ff65065f7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.087967 Jul 19 12:58:18.909041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 804/1749] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:18 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:58:19.048213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-54d55144-21b8-48be-9300-175c2e3f6070 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: .version_select at 0x7fd9943e25e0>, body: {"keypair": {"name": "tempest-keypair-1454176220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhnAwViVFyHnVsZUBgYfbuPwZ9pDthow7wcGAtTct8v65AqL21WcikTAo0OyQn92TcZ7mKWL1kH3UgjTlNPrix9S/asO8PGH2ISDCpvzKfOJ8RYWDolg9rryuA0f+p2sQ=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:58:19.063451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-54d55144-21b8-48be-9300-175c2e3f6070 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:58:19.067266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-54d55144-21b8-48be-9300-175c2e3f6070 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:58:19.089108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-54d55144-21b8-48be-9300-175c2e3f6070 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044817 Jul 19 12:58:19.090048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 946/1750] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 12:58:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:58:19.924842 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:19.925440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:19.933116 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:19.933571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:19.934369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:19.934936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:19.997226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:20.005206 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ba51e009-e206-44c8-b7c4-77ebde2f4477 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.084223 Jul 19 12:58:20.005811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 805/1751] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:19 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:20.302652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1732339573", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbcf9e05-75a4-4a6f-9f4c-53034463b4ca"}], "security_groups": [{"name": "tempest-securitygroup--1647406429"}], "key_name": "tempest-keypair-1454176220", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:58:20.403077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] validate_networks() for [('dbcf9e05-75a4-4a6f-9f4c-53034463b4ca', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 12:58:20.767128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 12:58:20.767552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 12:58:20.768025 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 12:58:20.768491 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 12:58:20.768920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 12:58:20.778287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:20.778737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:20.779535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:20.779970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:20.796673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 12:58:20.800947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Getting quotas for user 1a1284271e83435aa6fd851d6106e3a8 and project 3528f0d517e54016ab254ca0a3c11693. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 12:58:20.812784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 12:58:20.815030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 12:58:20.858837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ea5d237b-eb0b-471c-bcb8-4efa0ea99c3e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560877 Jul 19 12:58:20.859488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 947/1752] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 12:58:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 12:58:20.869913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2b21e08d-294a-4af4-815a-d68f6f1e7872 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:20.870535 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2b21e08d-294a-4af4-815a-d68f6f1e7872 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:20.922547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2b21e08d-294a-4af4-815a-d68f6f1e7872 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:20.930351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2b21e08d-294a-4af4-815a-d68f6f1e7872 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1242 microversion: 2.1 time: 0.064858 Jul 19 12:58:20.936545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 806/1753] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:20 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:21.022780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:21.023419 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:21.029533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:21.029984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:21.030745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:21.031174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:21.098147 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:21.106397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6cca610-b944-4095-b86d-bf3e42d835c7 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.087776 Jul 19 12:58:21.117990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 948/1754] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:21 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:21.947139 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:21.947595 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:21.955071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:21.955737 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:21.956623 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:21.957078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:22.020476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:22.027852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-eb7f8435-0fce-4ba9-a0c7-7667da480df9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1300 microversion: 2.1 time: 0.084907 Jul 19 12:58:22.028449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 807/1755] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:21 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:22.245484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:22.246095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:22.252448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:22.252940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:22.253758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:22.254177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:22.316762 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:22.324654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-adae330e-e47d-4d81-beaf-1e967521d82d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.202969 Jul 19 12:58:22.325225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 949/1756] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:22 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:23.045001 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:23.045838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:23.053201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:23.053787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:23.055186 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:23.055875 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:23.057379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-ddad07c1-1763-4d1b-b4a2-da504c5b9acd req-f50d5d8e-baf5-4213-b0a2-03fd5e84458d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b9f019-6159-4e16-96fb-b289a615193d", "tag": "28adc80e-6d2d-450f-9031-d1e8822db6c6"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:58:23.071044 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-ddad07c1-1763-4d1b-b4a2-da504c5b9acd req-f50d5d8e-baf5-4213-b0a2-03fd5e84458d service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:23.089464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-ddad07c1-1763-4d1b-b4a2-da504c5b9acd req-f50d5d8e-baf5-4213-b0a2-03fd5e84458d service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:23.106378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-ddad07c1-1763-4d1b-b4a2-da504c5b9acd req-f50d5d8e-baf5-4213-b0a2-03fd5e84458d service nova] Creating event network-changed:28adc80e-6d2d-450f-9031-d1e8822db6c6 for instance a0b9f019-6159-4e16-96fb-b289a615193d on hv-cinder-82099 Jul 19 12:58:23.112962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-ddad07c1-1763-4d1b-b4a2-da504c5b9acd req-f50d5d8e-baf5-4213-b0a2-03fd5e84458d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061263 Jul 19 12:58:23.117844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 950/1757] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:58:23.215329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:23.223063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ce49d63d-0c7f-4088-a413-296682271be0 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1368 microversion: 2.1 time: 0.182535 Jul 19 12:58:23.223751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 808/1758] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:23 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:23.342432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:23.343135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:23.349312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:23.349765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:23.350535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:23.350975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:23.422829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:23.431503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aba50040-06b0-4ee8-9e2c-5b8839bd2942 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.093640 Jul 19 12:58:23.432097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 951/1759] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:23 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:24.239013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:24.239640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:24.246382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:24.246832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:24.247601 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:24.248035 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:24.376450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:24.384459 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ce9a7ff6-7601-47c2-8698-fc11c6f10b99 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1368 microversion: 2.1 time: 0.149505 Jul 19 12:58:24.385027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 809/1760] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:24 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:24.448719 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:24.449332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:24.455732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:24.456208 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:24.456972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:24.457402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:24.518459 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:24.527322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-044b4be3-dd57-40c2-b51a-17024781db7a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.082879 Jul 19 12:58:24.527922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 952/1761] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:24 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:25.401219 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:25.401840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:25.407990 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:25.408476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:25.409237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:25.409674 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:25.537472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:25.543915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:25.544740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: cadeb57a-3504-4bac-86e9-e8ef951da265] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:25.551873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-62e7a4de-5db7-4c5b-86f3-1a5434e55187 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1368 microversion: 2.1 time: 0.148773 Jul 19 12:58:25.551978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:25.552260 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 810/1762] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:25 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:25.552390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:25.553154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:25.553605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:25.617585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:25.625689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a100784e-88bc-4b1c-98f5-ee353526b852 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265" status: 200 len: 1349 microversion: 2.1 time: 0.085759 Jul 19 12:58:25.626319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 953/1763] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:25 2022] GET /compute/v2.1/servers/cadeb57a-3504-4bac-86e9-e8ef951da265 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 12:58:26.561931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:26.562538 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:26.568926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:26.569373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:26.570128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:26.570567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:26.695725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:26.703084 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fd564e97-0039-408e-aa92-690d230808fb tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1368 microversion: 2.1 time: 0.145031 Jul 19 12:58:26.703653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 811/1764] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:26 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:27.042445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-5c76cad4-5ed5-4126-8a7f-377a9633df0b req-6cc2dd92-fdcb-416b-9d7b-85b105e9e11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b9f019-6159-4e16-96fb-b289a615193d", "name": "network-vif-plugged", "status": "completed", "tag": "28adc80e-6d2d-450f-9031-d1e8822db6c6"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:58:27.050950 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-5c76cad4-5ed5-4126-8a7f-377a9633df0b req-6cc2dd92-fdcb-416b-9d7b-85b105e9e11e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:27.051401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-5c76cad4-5ed5-4126-8a7f-377a9633df0b req-6cc2dd92-fdcb-416b-9d7b-85b105e9e11e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:27.062604 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-5c76cad4-5ed5-4126-8a7f-377a9633df0b req-6cc2dd92-fdcb-416b-9d7b-85b105e9e11e service nova] Creating event network-vif-plugged:28adc80e-6d2d-450f-9031-d1e8822db6c6 for instance a0b9f019-6159-4e16-96fb-b289a615193d on hv-cinder-82099 Jul 19 12:58:27.067543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-5c76cad4-5ed5-4126-8a7f-377a9633df0b req-6cc2dd92-fdcb-416b-9d7b-85b105e9e11e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029443 Jul 19 12:58:27.068421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 954/1765] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:58:27.719502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:27.720167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:27.727529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:27.727978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:27.728769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:27.729202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:27.856051 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:27.863338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9429088d-00e1-4909-9552-fbb1af350f0b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1368 microversion: 2.1 time: 0.147682 Jul 19 12:58:27.863946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 812/1766] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:27 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:28.881222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:28.881837 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:28.888063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:28.888553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:28.889321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:28.889757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:29.015117 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 12:58:29.022687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df96f40a-a91b-4b80-9abd-06783ef04d7b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1559 microversion: 2.1 time: 0.146324 Jul 19 12:58:29.023246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 955/1767] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 12:58:28 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 12:58:29.038890 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c768c01a-f60a-449a-8972-4130855f9b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:58:29.039384 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c768c01a-f60a-449a-8972-4130855f9b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:58:29.046416 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c768c01a-f60a-449a-8972-4130855f9b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:29.046873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c768c01a-f60a-449a-8972-4130855f9b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:29.047629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c768c01a-f60a-449a-8972-4130855f9b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:29.048064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c768c01a-f60a-449a-8972-4130855f9b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:29.122011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c768c01a-f60a-449a-8972-4130855f9b54 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086877 Jul 19 12:58:29.122603 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 813/1768] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jul 19 12:58:29 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:58:30.037396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-04228460-a0ed-4e51-8bb2-23b56b83a586 req-7ed8d90c-665c-4dc5-a77f-94f5bb32cd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b9f019-6159-4e16-96fb-b289a615193d", "tag": "28adc80e-6d2d-450f-9031-d1e8822db6c6"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 12:58:30.045879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-04228460-a0ed-4e51-8bb2-23b56b83a586 req-7ed8d90c-665c-4dc5-a77f-94f5bb32cd16 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:58:30.046322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-04228460-a0ed-4e51-8bb2-23b56b83a586 req-7ed8d90c-665c-4dc5-a77f-94f5bb32cd16 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:58:30.057332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-04228460-a0ed-4e51-8bb2-23b56b83a586 req-7ed8d90c-665c-4dc5-a77f-94f5bb32cd16 service nova] Creating event network-changed:28adc80e-6d2d-450f-9031-d1e8822db6c6 for instance a0b9f019-6159-4e16-96fb-b289a615193d on hv-cinder-82099 Jul 19 12:58:30.062724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-04228460-a0ed-4e51-8bb2-23b56b83a586 req-7ed8d90c-665c-4dc5-a77f-94f5bb32cd16 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028926 Jul 19 12:58:30.063669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 956/1769] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 12:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 12:59:06.117549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:59:06.119056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:59:06.120245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:59:06.124861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0ee06cc7-0c26-4e05-bd66-296298521506 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 12:59:06.125362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0ee06cc7-0c26-4e05-bd66-296298521506 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 12:59:06.133893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee06cc7-0c26-4e05-bd66-296298521506 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:59:06.134351 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee06cc7-0c26-4e05-bd66-296298521506 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:59:06.135127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee06cc7-0c26-4e05-bd66-296298521506 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 12:59:06.135575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0ee06cc7-0c26-4e05-bd66-296298521506 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 12:59:06.159774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0ee06cc7-0c26-4e05-bd66-296298521506 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d/ips" status: 200 len: 151 microversion: 2.1 time: 0.043788 Jul 19 12:59:06.160360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 814/1770] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 12:59:06 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:00:06.231454 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:00:06.232227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=10 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:00:06.232983 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:00:06.233593 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=85 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:00:06.237919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:06.238525 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:06.247314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:06.247763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:06.248554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:06.248989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:06.274225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:00:06.345748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1917f73-93dc-4803-a739-ac1ca2b3013c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 204 len: 0 microversion: 2.1 time: 0.115741 Jul 19 13:00:06.346291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 957/1771] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:00:06 2022] DELETE /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 13:00:06.353034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:00:06.353855 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:00:06.357686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:06.358299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:06.365003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:06.365461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:06.366221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:06.366658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:06.502231 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:00:06.509780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-762b20d3-b3dd-49c9-8a0f-05917c0892c5 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1684 microversion: 2.1 time: 0.158510 Jul 19 13:00:06.510378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 815/1772] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:00:06 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:00:07.527530 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:07.529274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:07.535166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:07.535622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:07.536434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:07.536872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:07.664278 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:00:07.671723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dd456844-2361-496c-b936-d924bbac37ae tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1684 microversion: 2.1 time: 0.148583 Jul 19 13:00:07.672353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 958/1773] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:00:07 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:00:08.539814 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-2d7c298b-9f64-4fac-afef-571befc0c7e9 req-ab358f6a-cf54-4183-8edc-528f00fe5dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b9f019-6159-4e16-96fb-b289a615193d", "name": "network-vif-deleted", "tag": "28adc80e-6d2d-450f-9031-d1e8822db6c6"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:00:08.555300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-2d7c298b-9f64-4fac-afef-571befc0c7e9 req-ab358f6a-cf54-4183-8edc-528f00fe5dc5 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:08.555575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-2d7c298b-9f64-4fac-afef-571befc0c7e9 req-ab358f6a-cf54-4183-8edc-528f00fe5dc5 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:08.568208 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-2d7c298b-9f64-4fac-afef-571befc0c7e9 req-ab358f6a-cf54-4183-8edc-528f00fe5dc5 service nova] Creating event network-vif-deleted:28adc80e-6d2d-450f-9031-d1e8822db6c6 for instance a0b9f019-6159-4e16-96fb-b289a615193d on hv-cinder-82099 Jul 19 13:00:08.574484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-2d7c298b-9f64-4fac-afef-571befc0c7e9 req-ab358f6a-cf54-4183-8edc-528f00fe5dc5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038171 Jul 19 13:00:08.575204 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 816/1774] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:00:08.689193 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:08.689908 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:08.697081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:08.697701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:08.698549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:08.699058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:08.732199 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:08.732572 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:08.733220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lazy-loading 'fault' on Instance uuid a0b9f019-6159-4e16-96fb-b289a615193d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:00:08.775555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1284271e83435aa6fd851d6106e3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3528f0d517e54016ab254ca0a3c11693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:00:08.783918 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b64e00a8-da89-4ca3-968f-10d02f670cb3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 200 len: 1332 microversion: 2.1 time: 0.098592 Jul 19 13:00:08.785116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 959/1775] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:00:08 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:00:09.802687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:09.803384 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:09.810059 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:09.810508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:09.811260 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:09.811695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:09.826014 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d HTTP/1.1 Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:00:09.828086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:09.830130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'a0b9f019-6159-4e16-96fb-b289a615193d'} Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:00:09.831229 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:09.832948 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:09.834226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:00:09.834226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-15e0ba4a-b1fa-44a9-a04e-7f4f5e8ee5d3 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 404 len: 111 microversion: 2.1 time: 0.031882 Jul 19 13:00:09.834226 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 817/1776] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:00:09 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:00:09.838991 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aabdc98c-628e-4820-ae90-49206e136bb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '.version_select at 0x7fd99456fe50>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:09.855905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aabdc98c-628e-4820-ae90-49206e136bb2 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454176220" status: 202 len: 0 microversion: 2.1 time: 0.020687 Jul 19 13:00:09.856572 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 960/1777] 10.222.0.13 () {58 vars in 1220 bytes} [Tue Jul 19 13:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454176220 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:00:10.482686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:10.483189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:10.490065 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.490850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.492232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.492947 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.508208 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d HTTP/1.1 Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:00:10.509794 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.512148 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'a0b9f019-6159-4e16-96fb-b289a615193d'} Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:00:10.513188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.514820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.516512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:00:10.516512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e6c33286-081f-491a-a137-6d9dd8f6a7f8 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 404 len: 111 microversion: 2.1 time: 0.033786 Jul 19 13:00:10.516512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 818/1778] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:00:10 2022] DELETE /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:00:10.522580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:10.523186 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: a0b9f019-6159-4e16-96fb-b289a615193d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:10.530138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.530688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.531488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.531962 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.545287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d HTTP/1.1 Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:00:10.546938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.548649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'a0b9f019-6159-4e16-96fb-b289a615193d'} Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:00:10.549603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. Jul 19 13:00:10.551207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.552705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance a0b9f019-6159-4e16-96fb-b289a615193d could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:00:10.552705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5126c513-9f06-4c19-afe1-9fbae975d25e tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d" status: 404 len: 111 microversion: 2.1 time: 0.029795 Jul 19 13:00:10.552705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 961/1779] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:00:10 2022] GET /compute/v2.1/servers/a0b9f019-6159-4e16-96fb-b289a615193d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:00:10.557311 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:10.557823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:10.563867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.564360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.565131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.565579 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.579281 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 HTTP/1.1 Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:00:10.580935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.582724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '439906e0-742e-40df-bd40-7b2bee31fed8'} Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:00:10.583702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.585338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.586920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:00:10.586920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1fd08e15-5b0c-420f-8aa2-e56585c92a2c tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 404 len: 111 microversion: 2.1 time: 0.029298 Jul 19 13:00:10.586920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 819/1780] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:00:10 2022] DELETE /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:00:10.590790 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:10.591405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: 439906e0-742e-40df-bd40-7b2bee31fed8] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:10.597401 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.597861 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.598626 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.599067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.615151 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 HTTP/1.1 Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:00:10.616700 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.618524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '439906e0-742e-40df-bd40-7b2bee31fed8'} Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:00:10.620037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. Jul 19 13:00:10.621395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.622606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance 439906e0-742e-40df-bd40-7b2bee31fed8 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:00:10.622606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc875ce2-54fd-4721-a9fd-240a4723d0e9 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8" status: 404 len: 111 microversion: 2.1 time: 0.031120 Jul 19 13:00:10.622606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 962/1781] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:00:10 2022] GET /compute/v2.1/servers/439906e0-742e-40df-bd40-7b2bee31fed8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:00:10.627173 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:10.627671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:10.633793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.634245 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.635579 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.635974 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.649393 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 HTTP/1.1 Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:00:10.650866 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.652590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'dc37091a-e1a5-4272-b216-e15ef76abfc3'} Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:00:10.653530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.655143 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.657090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:00:10.657090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-82b923ef-3789-46dc-a0e2-22793dec62da tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 404 len: 111 microversion: 2.1 time: 0.028863 Jul 19 13:00:10.657090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 820/1782] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:00:10 2022] DELETE /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:00:10.660478 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:00:10.661088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dc37091a-e1a5-4272-b216-e15ef76abfc3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:00:10.667067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.667516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.668289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:00:10.668735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:00:10.681687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 HTTP/1.1 Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:00:10.683744 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.685469 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'dc37091a-e1a5-4272-b216-e15ef76abfc3'} Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:00:10.686341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. Jul 19 13:00:10.687619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:00:10.688815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance dc37091a-e1a5-4272-b216-e15ef76abfc3 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:00:10.688815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0aca78bf-0c27-44f4-9421-2903ae002626 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3" status: 404 len: 111 microversion: 2.1 time: 0.028377 Jul 19 13:00:10.688815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 963/1783] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:00:10 2022] GET /compute/v2.1/servers/dc37091a-e1a5-4272-b216-e15ef76abfc3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:00:55.180906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:00:55.181511 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:00:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:01:14.279450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:01:14.280074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:01:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:01:16.363522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:01:16.364077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:01:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:03:04.192257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:03:04.192799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:03:04.472662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52daa4b8-d88a-4627-ba2e-0f8e7ec16d2c] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 13:03:04.473167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=12 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:04.474075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=16 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:04.477826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:04.478324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:04.485784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:04.486233 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:04.487020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:04.487451 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:04.512387 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Going to try to terminate instance {{(pid=118119) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:03:04.585315 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6ba21995-785e-421b-ac15-baa784dd8731 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "DELETE /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 204 len: 0 microversion: 2.20 time: 0.114314 Jul 19 13:03:04.585892 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 821/1784] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jul 19 13:03:04 2022] DELETE /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 13:03:04.592224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [68ed09c9-7423-4667-be4e-66575e976407] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 13:03:04.592821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:04.593554 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:04.597514 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:04.598127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:04.607990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:04.607990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:04.607990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:04.607990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:04.803211 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:04.811667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:04.813178 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:04.814346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ced094aa-4419-46b3-95e7-acd9b46917c2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1724 microversion: 2.20 time: 0.224198 Jul 19 13:03:04.814930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 964/1785] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:04 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:05.793746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52daa4b8-d88a-4627-ba2e-0f8e7ec16d2c] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 37554. Jul 19 13:03:05.832299 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:05.832919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:05.841821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:05.842549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:05.843508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:05.843932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-bdeb8134-58bf-4575-b323-75fd9cf06dc2 req-1827b20b-0d39-47b6-a043-9970b753a510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beddcf3c-9050-464a-ae8b-6e09f54bd9cd", "name": "network-vif-deleted", "tag": "91bb6764-d84f-4b06-9b58-a57ac64d386d"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:03:05.844375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:05.859901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-bdeb8134-58bf-4575-b323-75fd9cf06dc2 req-1827b20b-0d39-47b6-a043-9970b753a510 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:05.861034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-bdeb8134-58bf-4575-b323-75fd9cf06dc2 req-1827b20b-0d39-47b6-a043-9970b753a510 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:05.867607 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] [68ed09c9-7423-4667-be4e-66575e976407] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 37558. Jul 19 13:03:05.874971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-bdeb8134-58bf-4575-b323-75fd9cf06dc2 req-1827b20b-0d39-47b6-a043-9970b753a510 service nova] Creating event network-vif-deleted:91bb6764-d84f-4b06-9b58-a57ac64d386d for instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd on hv-cinder-82099 Jul 19 13:03:05.881125 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-bdeb8134-58bf-4575-b323-75fd9cf06dc2 req-1827b20b-0d39-47b6-a043-9970b753a510 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105625 Jul 19 13:03:05.882238 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 822/1786] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:03:05.925763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:05.934924 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:05.936639 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:05.937795 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-756a0505-b4b5-4f3c-9ba3-0de6fbbc3160 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 200 len: 1366 microversion: 2.20 time: 0.109393 Jul 19 13:03:05.938754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 965/1787] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:05 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 13:03:06.957231 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:06.957955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:06.964263 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:06.964717 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:06.965475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:06.965911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:06.978619 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] HTTP exception thrown: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Request method failure captured: Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd HTTP/1.1 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qmOsIxYGKVkVvCQ0X0RdjSqKGakTh9dUnQ4xZ_Hf0fzBWdxzU1C1ny0aKeTR8-C2Lkr1PdHr0NZ62bnrtOdE5UmfyOLQxqLgzAyLkFm5rz6paNdZdyKYHawSN2iYevvk06JR32AkFXukCjI9EbBTH7HTIVno5VPQYoGUDogK_TRQs4 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:03:06.980220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c364ae782cdb4e43ad3dd6f4dddc9520", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 93ebf48bf50b455fa85d3e7ad9164a04 Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:03:06.982191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'beddcf3c-9050-464a-ae8b-6e09f54bd9cd'} Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:03:06.983210 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:03:06.984918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:03:06.986483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Returning 404 to user: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:03:06.986483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0e71daf0-70b2-4399-8c55-710df2fb4770 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 404 len: 111 microversion: 2.20 time: 0.029210 Jul 19 13:03:06.986483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 823/1788] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:06 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 13:03:06.990326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-743fbd31-880e-410d-b3f2-f9f8d1170b22 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '.version_select at 0x7fd994351a60>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:06.994064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-743fbd31-880e-410d-b3f2-f9f8d1170b22 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [77f5104d-d9e5-459f-8797-89cb94aaa1a2] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 13:03:08.000603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [None req-743fbd31-880e-410d-b3f2-f9f8d1170b22 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [77f5104d-d9e5-459f-8797-89cb94aaa1a2] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 37576. Jul 19 13:03:08.019385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-743fbd31-880e-410d-b3f2-f9f8d1170b22 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645717984" status: 204 len: 0 microversion: 2.20 time: 1.032903 Jul 19 13:03:08.020017 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 966/1789] 10.222.0.13 () {60 vars in 1258 bytes} [Tue Jul 19 13:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645717984 => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 13:03:08.871335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dc9dafca-7d53-4c93-a157-01c3c857d971 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Action: 'create', calling method: .version_select at 0x7fd99436ca60>, body: {"keypair": {"name": "tempest-keypair-534692270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT4T27ivArxNz/WacOfNzjfr2JSffRpMFyBXD/pgYkhQXnHhyp/2/Il89zfpuiKSbCp9v+vMevPt1VNQGGJbU0DXh5wi6J39GU0wTdIvkFHCSDKY3ihLurSbE20x8GnwA=="}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:03:08.885056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-dc9dafca-7d53-4c93-a157-01c3c857d971 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:03:08.888791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-dc9dafca-7d53-4c93-a157-01c3c857d971 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for user 93ebf48bf50b455fa85d3e7ad9164a04 and project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:03:08.912361 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dc9dafca-7d53-4c93-a157-01c3c857d971 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045478 Jul 19 13:03:08.912938 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 824/1790] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Jul 19 13:03:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 13:03:10.313391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-31839867", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9a061e3-8575-4b9d-bb9f-6929998aae70"}], "security_groups": [{"name": "tempest-securitygroup--354925498"}], "key_name": "tempest-keypair-534692270", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:03:10.412096 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] validate_networks() for [('e9a061e3-8575-4b9d-bb9f-6929998aae70', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 13:03:10.817695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 13:03:10.818107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 13:03:10.818584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 13:03:10.818993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 13:03:10.819404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 13:03:10.828752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:10.829201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:10.830003 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:10.830442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:10.847566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:03:10.851501 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Getting quotas for user 93ebf48bf50b455fa85d3e7ad9164a04 and project c364ae782cdb4e43ad3dd6f4dddc9520. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:03:10.862259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 13:03:10.864485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 13:03:10.912831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-816883cc-9505-44af-a40a-4f02d58d8981 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.604339 Jul 19 13:03:10.913690 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 967/1791] 10.222.0.13 () {62 vars in 1187 bytes} [Tue Jul 19 13:03:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 13:03:10.924469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0b163eb4-32b4-4bd7-b709-8fcbaba72571 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:10.925090 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0b163eb4-32b4-4bd7-b709-8fcbaba72571 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:11.023734 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0b163eb4-32b4-4bd7-b709-8fcbaba72571 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:11.030984 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0b163eb4-32b4-4bd7-b709-8fcbaba72571 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:11.032695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0b163eb4-32b4-4bd7-b709-8fcbaba72571 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:11.033885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0b163eb4-32b4-4bd7-b709-8fcbaba72571 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1279 microversion: 2.20 time: 0.114400 Jul 19 13:03:11.034505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 825/1792] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:10 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:12.052775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:12.053384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:12.059835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:12.060319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:12.061092 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:12.061519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:12.122246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:12.130141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:12.131657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:12.133339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-443fc807-a840-4ee7-b7c9-1cb4f761f851 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1337 microversion: 2.20 time: 0.085056 Jul 19 13:03:12.133888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 968/1793] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:12 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1337 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:13.150996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:13.151621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:13.158088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:13.158549 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:13.159353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:13.159808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:13.172332 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-70626d17-2aa1-4920-bead-bf47af48d980 req-e3c59986-51f3-4293-a7ca-5ac083662fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02d04f6-ff39-4236-b2b9-9e02c48cb76a", "tag": "4c5945a2-55a0-4db1-828c-6ff9fc4d020f"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:03:13.182999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-70626d17-2aa1-4920-bead-bf47af48d980 req-e3c59986-51f3-4293-a7ca-5ac083662fcc service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:13.183702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-70626d17-2aa1-4920-bead-bf47af48d980 req-e3c59986-51f3-4293-a7ca-5ac083662fcc service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:13.196070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-70626d17-2aa1-4920-bead-bf47af48d980 req-e3c59986-51f3-4293-a7ca-5ac083662fcc service nova] Creating event network-changed:4c5945a2-55a0-4db1-828c-6ff9fc4d020f for instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a on hv-cinder-82099 Jul 19 13:03:13.207115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-70626d17-2aa1-4920-bead-bf47af48d980 req-e3c59986-51f3-4293-a7ca-5ac083662fcc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040434 Jul 19 13:03:13.208284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 969/1794] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:03:13.342661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:13.351920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:13.353571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:13.354779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-db976213-4515-4f05-8aef-c0340faa81da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1404 microversion: 2.20 time: 0.207757 Jul 19 13:03:13.355417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 826/1795] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:13 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1404 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:14.373235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:14.373936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:14.380515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:14.380971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:14.381747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:14.382233 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:14.519516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:14.528657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:14.530200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:14.531328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18f27276-8f4e-40b7-9d3a-939a4de3b454 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1404 microversion: 2.20 time: 0.162399 Jul 19 13:03:14.532215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 970/1796] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:14 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:15.550179 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:15.550799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:15.557314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:15.557768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:15.558523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:15.558964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:15.687917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:15.696356 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:15.697867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:15.698965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-50364646-0d12-4dc4-86f8-751c31a1de62 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1404 microversion: 2.20 time: 0.152700 Jul 19 13:03:15.699519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 827/1797] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:15 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:16.690742 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-68864075-a9a0-405b-8dd7-4888ae4f3bf2 req-e1ce3e40-a147-46c0-8f9b-cc6d1a098ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02d04f6-ff39-4236-b2b9-9e02c48cb76a", "name": "network-vif-plugged", "status": "completed", "tag": "4c5945a2-55a0-4db1-828c-6ff9fc4d020f"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:03:16.698938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-68864075-a9a0-405b-8dd7-4888ae4f3bf2 req-e1ce3e40-a147-46c0-8f9b-cc6d1a098ad4 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:16.699384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-68864075-a9a0-405b-8dd7-4888ae4f3bf2 req-e1ce3e40-a147-46c0-8f9b-cc6d1a098ad4 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:16.711418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-68864075-a9a0-405b-8dd7-4888ae4f3bf2 req-e1ce3e40-a147-46c0-8f9b-cc6d1a098ad4 service nova] Creating event network-vif-plugged:4c5945a2-55a0-4db1-828c-6ff9fc4d020f for instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a on hv-cinder-82099 Jul 19 13:03:16.716382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-68864075-a9a0-405b-8dd7-4888ae4f3bf2 req-e1ce3e40-a147-46c0-8f9b-cc6d1a098ad4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078947 Jul 19 13:03:16.717104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 971/1798] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:03:16.718202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:16.718829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:16.725614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:16.726630 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:16.727394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:16.728060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:16.860910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:16.868740 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:16.870738 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:16.871838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-47c9fdd5-b5c8-4d30-b926-739150addd31 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1404 microversion: 2.20 time: 0.159413 Jul 19 13:03:16.872433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 828/1799] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:16 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 13:03:17.889987 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:17.890609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:17.897522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:17.897980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:17.898748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:17.899204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:18.031810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:18.040425 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:18.041932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:18.043031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f76f95e-e363-4295-a9ff-9120da7bcc7f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1404 microversion: 2.20 time: 0.157375 Jul 19 13:03:18.043581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 972/1800] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:17 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:19.061061 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:19.061751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:19.068202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:19.068669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:19.069591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:19.069914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:19.195962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:19.203767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:19.205286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:03:19.206418 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fe96024c-e195-4f28-b45e-ed78f51b6033 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1597 microversion: 2.20 time: 0.149312 Jul 19 13:03:19.206968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 829/1801] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:03:19 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1597 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:03:19.223141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4da75cf1-ba5d-419b-9acc-0abb2c035e38 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:19.223650 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4da75cf1-ba5d-419b-9acc-0abb2c035e38 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:19.230534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da75cf1-ba5d-419b-9acc-0abb2c035e38 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:19.230981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da75cf1-ba5d-419b-9acc-0abb2c035e38 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:19.231738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da75cf1-ba5d-419b-9acc-0abb2c035e38 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:19.232189 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4da75cf1-ba5d-419b-9acc-0abb2c035e38 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:19.306624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4da75cf1-ba5d-419b-9acc-0abb2c035e38 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087258 Jul 19 13:03:19.307214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 973/1802] 10.222.0.13 () {60 vars in 1315 bytes} [Tue Jul 19 13:03:19 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 13:03:20.267996 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-9bab18cd-1da0-4417-8fef-3b483d4aebf1 req-abeb237e-7c0d-4bb9-a45b-8b966bbb2c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02d04f6-ff39-4236-b2b9-9e02c48cb76a", "tag": "4c5945a2-55a0-4db1-828c-6ff9fc4d020f"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:03:20.275796 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-9bab18cd-1da0-4417-8fef-3b483d4aebf1 req-abeb237e-7c0d-4bb9-a45b-8b966bbb2c05 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:20.276267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-9bab18cd-1da0-4417-8fef-3b483d4aebf1 req-abeb237e-7c0d-4bb9-a45b-8b966bbb2c05 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:20.286772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-9bab18cd-1da0-4417-8fef-3b483d4aebf1 req-abeb237e-7c0d-4bb9-a45b-8b966bbb2c05 service nova] Creating event network-changed:4c5945a2-55a0-4db1-828c-6ff9fc4d020f for instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a on hv-cinder-82099 Jul 19 13:03:20.292009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-9bab18cd-1da0-4417-8fef-3b483d4aebf1 req-abeb237e-7c0d-4bb9-a45b-8b966bbb2c05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081389 Jul 19 13:03:20.292852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 830/1803] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:03:49.614433 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:49.614884 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:49.615703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:49.616656 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=40 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:03:49.621326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7a398793-f713-46de-874a-4ad28657c6af tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:03:49.622013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7a398793-f713-46de-874a-4ad28657c6af tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:03:49.630816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a398793-f713-46de-874a-4ad28657c6af tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:49.631265 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a398793-f713-46de-874a-4ad28657c6af tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:49.632058 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a398793-f713-46de-874a-4ad28657c6af tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:03:49.632516 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a398793-f713-46de-874a-4ad28657c6af tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:03:49.656651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7a398793-f713-46de-874a-4ad28657c6af tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/ips" status: 200 len: 153 microversion: 2.20 time: 0.044139 Jul 19 13:03:49.657199 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 974/1804] 10.222.0.13 () {60 vars in 1288 bytes} [Tue Jul 19 13:03:49 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 13:04:36.371456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:04:36.372023 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:04:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:05:07.010636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:07.011522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:07.012267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:07.016644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:07.017258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:07.026232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:07.026687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:07.027478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:07.027908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:07.051254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lazy-loading 'flavor' on Instance uuid a02d04f6-ff39-4236-b2b9-9e02c48cb76a {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:07.304526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-966c4147-11a5-4fef-a3c1-1c472c0bacde tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "POST /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/action" status: 202 len: 0 microversion: 2.20 time: 0.295828 Jul 19 13:05:07.305141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 831/1805] 10.222.0.13 () {62 vars in 1318 bytes} [Tue Jul 19 13:05:07 2022] POST /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 13:05:07.311602 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:07.312396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:07.316306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:07.316919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:07.324651 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:07.325107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:07.325881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:07.326323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:07.456680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:07.464721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:07.466220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:07.467369 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fad28725-03fb-491a-a130-df07de27db37 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.157410 Jul 19 13:05:07.467913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 975/1806] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:07 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:08.486167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:08.486889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:08.493089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:08.493541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:08.494295 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:08.494732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:08.624009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:08.631743 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:08.633265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:08.634408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ad7dac71-c4aa-4c58-8925-4f9eaec5d064 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.153015 Jul 19 13:05:08.635457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 832/1807] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:08 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:09.657745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:09.658367 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:09.664912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:09.665385 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:09.666717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:09.667173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:09.794232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:09.802097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:09.803612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:09.804802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4aca5c6b-f69d-4423-8a05-0c1edacf91de tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.150969 Jul 19 13:05:09.805367 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 976/1808] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:09 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:10.822808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:10.823334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:10.829703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:10.830159 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:10.830926 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:10.831365 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:10.961897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:10.969684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:10.971174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:10.972345 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-db239af4-9330-45c4-9fd7-17b3c9bbbeeb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.153539 Jul 19 13:05:10.972901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 833/1809] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:10 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:11.991217 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:11.991858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:11.998089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:11.998553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:11.999336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:11.999779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:12.003460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1316580481", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "networks": [{"uuid": "17ad8a1f-844a-4ab8-8940-bf22e9103dfa"}]}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:12.055185 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] validate_networks() for [('17ad8a1f-844a-4ab8-8940-bf22e9103dfa', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 13:05:12.207034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:12.215930 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:12.217467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:12.218635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-defdff71-5611-4431-9133-90327f1e4fac tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.231217 Jul 19 13:05:12.219207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 977/1810] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:11 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:12.551557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 13:05:12.552094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 13:05:12.552739 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 13:05:12.553142 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 13:05:12.553580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 13:05:12.562249 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:12.562700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:12.563528 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:12.563960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:12.580414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Getting quotas for project 6f6b44bed4904d50b5f1ebfc5ab34743. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:05:12.584284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Getting quotas for user 70c035662359493e86c58a3d40150eb8 and project 6f6b44bed4904d50b5f1ebfc5ab34743. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:05:12.595306 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 13:05:12.597485 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 13:05:12.644541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-95c4d103-9239-419a-9c44-f6dc034c1988 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645000 Jul 19 13:05:12.645179 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 834/1811] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 13:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 13:05:12.655623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10f51d39-e361-4b0a-8cdd-87e04d75f056 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:12.656244 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10f51d39-e361-4b0a-8cdd-87e04d75f056 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:12.709022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-10f51d39-e361-4b0a-8cdd-87e04d75f056 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:12.717327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10f51d39-e361-4b0a-8cdd-87e04d75f056 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1219 microversion: 2.1 time: 0.064815 Jul 19 13:05:12.718283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 978/1812] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:12 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:13.236835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:13.237493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:13.244757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:13.245217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:13.245993 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:13.246438 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:13.376463 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:13.384358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:13.386500 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:13.387654 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5deac723-c033-4c7c-a4ea-0710752d2122 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.155394 Jul 19 13:05:13.388220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 835/1813] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:13 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:13.735278 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:13.735883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:13.743766 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:13.744808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:13.745597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:13.746034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:13.813088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:13.820919 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-34d28cba-12a7-4b3d-ac3a-202ed18e9143 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1277 microversion: 2.1 time: 0.089558 Jul 19 13:05:13.821508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 979/1814] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:13 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:14.406179 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:14.406816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:14.413272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:14.413731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:14.414514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:14.414952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:14.545133 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:14.553761 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:14.555338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:14.556636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9efa2d79-8e64-4d83-8dcd-94a13d0ebc5b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.154335 Jul 19 13:05:14.557201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 836/1815] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:14 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:14.838339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:14.839201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:14.846417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:14.846992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:14.848010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:14.848542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:14.985809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:14.993729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78192d45-dc27-4166-ad69-56c887df6145 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1319 microversion: 2.1 time: 0.159352 Jul 19 13:05:14.995020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 980/1816] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:14 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:15.005961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-91db1408-c846-4d1c-bccc-1be43363fb91 req-c81396b2-52ec-4bcb-a6e7-938b71324251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6553d3-ea99-43a1-a5f0-dab08319ca39", "tag": "6ad9c929-8c66-4b3a-be74-3cdbe6bb2f38"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:15.017060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-91db1408-c846-4d1c-bccc-1be43363fb91 req-c81396b2-52ec-4bcb-a6e7-938b71324251 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:15.017853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-91db1408-c846-4d1c-bccc-1be43363fb91 req-c81396b2-52ec-4bcb-a6e7-938b71324251 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:15.038774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-91db1408-c846-4d1c-bccc-1be43363fb91 req-c81396b2-52ec-4bcb-a6e7-938b71324251 service nova] Creating event network-changed:6ad9c929-8c66-4b3a-be74-3cdbe6bb2f38 for instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 on hv-cinder-82099 Jul 19 13:05:15.044563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-91db1408-c846-4d1c-bccc-1be43363fb91 req-c81396b2-52ec-4bcb-a6e7-938b71324251 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043180 Jul 19 13:05:15.045497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 837/1817] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:05:15.574965 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:15.575496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:15.581543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:15.582000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:15.582765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:15.583205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:15.708283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:15.716614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:15.718108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:15.719262 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f098236f-8972-4c82-a609-9204fadd9262 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.148380 Jul 19 13:05:15.719823 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 981/1818] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:15 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:16.011761 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:16.012493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:16.019296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:16.019745 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:16.020533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:16.020971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:16.155512 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:16.163170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a85aeeb0-867f-49ba-a868-6921ce022944 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1319 microversion: 2.1 time: 0.156002 Jul 19 13:05:16.163849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 838/1819] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:16 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:16.738083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:16.738694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:16.745809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:16.746257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:16.747019 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:16.747456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:16.873267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:16.881194 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:16.882703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:16.883853 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-59257277-e709-4d1b-9142-431641b56052 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.149692 Jul 19 13:05:16.884451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 982/1820] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:16 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:17.180554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:17.181195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:17.187966 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:17.188453 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:17.189424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:17.189863 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:17.318994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:17.326566 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f77476df-d173-4c5e-9317-4811f13ebc5e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1319 microversion: 2.1 time: 0.150115 Jul 19 13:05:17.327069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 839/1821] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:17 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:17.902647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:17.903234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:17.909660 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:17.910105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:17.910862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:17.911291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:18.041305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:18.049120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:18.050617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:18.051763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0b1f44bb-bafd-42a6-a402-ca32bacb6002 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.153155 Jul 19 13:05:18.052338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 983/1822] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:17 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:18.343236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:18.343853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:18.350437 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:18.350900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:18.351663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:18.352105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:18.480075 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:18.488430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e14946ea-fe11-4834-9ed6-7a2d07656772 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1319 microversion: 2.1 time: 0.149048 Jul 19 13:05:18.489030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 840/1823] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:18 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:19.070075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:19.070685 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:19.077519 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:19.077967 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:19.078756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:19.079191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:19.140675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-b2d5c9ff-cf72-4599-a4e2-a8be652b306e req-2247c1d4-61f8-4cff-b626-a2e19d18c242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6553d3-ea99-43a1-a5f0-dab08319ca39", "name": "network-vif-plugged", "status": "completed", "tag": "6ad9c929-8c66-4b3a-be74-3cdbe6bb2f38"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:19.149424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-b2d5c9ff-cf72-4599-a4e2-a8be652b306e req-2247c1d4-61f8-4cff-b626-a2e19d18c242 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:19.149885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-b2d5c9ff-cf72-4599-a4e2-a8be652b306e req-2247c1d4-61f8-4cff-b626-a2e19d18c242 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:19.161927 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-b2d5c9ff-cf72-4599-a4e2-a8be652b306e req-2247c1d4-61f8-4cff-b626-a2e19d18c242 service nova] Creating event network-vif-plugged:6ad9c929-8c66-4b3a-be74-3cdbe6bb2f38 for instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 on hv-cinder-82099 Jul 19 13:05:19.167236 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-b2d5c9ff-cf72-4599-a4e2-a8be652b306e req-2247c1d4-61f8-4cff-b626-a2e19d18c242 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 Jul 19 13:05:19.167852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 841/1824] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:05:19.218418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:19.226652 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:19.228344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:19.229902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c87ce0c5-bd61-45e8-a293-cbb2367f0958 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.163653 Jul 19 13:05:19.230734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 984/1825] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:19 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:19.506526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:19.507234 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:19.513985 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:19.514439 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:19.515205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:19.515649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:19.642795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:19.650628 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-babbd55e-2aac-47ce-a092-0b5f0ad8d4ce tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1319 microversion: 2.1 time: 0.148746 Jul 19 13:05:19.651205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 842/1826] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:19 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:20.248103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:20.248736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:20.255173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:20.255618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:20.256413 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:20.256841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:20.389155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:20.397447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:20.399054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:20.400902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2299d0fb-c913-4064-b032-2737ace8b5d5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.156052 Jul 19 13:05:20.401510 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 985/1827] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:20 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:20.666805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:20.667427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:20.673906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:20.674364 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:20.675135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:20.675581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:20.812602 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:20.820220 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-81a1b23e-db5b-4409-a65f-e176ef657496 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1507 microversion: 2.1 time: 0.157240 Jul 19 13:05:20.820802 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 843/1828] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:20 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:20.837230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-422aa313-4655-4894-a08c-663498405d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d51958fc-ecd0-4d58-9f71-aa31dc5563ba", "device": "/dev/sdb"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:20.838845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-422aa313-4655-4894-a08c-663498405d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:20.844872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-422aa313-4655-4894-a08c-663498405d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:20.845319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-422aa313-4655-4894-a08c-663498405d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:20.846070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-422aa313-4655-4894-a08c-663498405d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:20.846502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-422aa313-4655-4894-a08c-663498405d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:21.069488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-422aa313-4655-4894-a08c-663498405d40 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "POST /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.235931 Jul 19 13:05:21.070112 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 986/1829] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 13:05:20 2022] POST /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39/os-volume_attachments => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:05:21.419641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:21.420209 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:21.426155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:21.426612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:21.427375 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:21.427846 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:21.556594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:21.564402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:21.565912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:21.567069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a04e8950-a960-47d6-9c29-edf3d77829eb tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.151950 Jul 19 13:05:21.567634 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 844/1830] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:21 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:22.585915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:22.586627 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:22.592833 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:22.593284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:22.594053 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:22.594494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:22.714076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:22.726036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:22.734372 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:22.735886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:22.737077 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fb4e6e41-453f-4df1-a0fa-90a5b24738aa tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.155879 Jul 19 13:05:22.737631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 987/1831] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:22 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:23.755520 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:23.756141 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:23.758559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:23.759370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:23.766205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:23.766665 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:23.767438 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:23.767883 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:23.892715 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:23.900798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:23.902316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:23.903478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-44a1802b-5fa9-4094-bdc1-d10fb3d35243 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1743 microversion: 2.20 time: 0.151889 Jul 19 13:05:23.904042 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 845/1832] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:23 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:24.921482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:24.922088 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:24.928500 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:24.928948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:24.929703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:24.930134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:25.200519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-660a39fb-86da-42ba-ace2-3a78cf739f4a req-305ef33b-7d03-4aff-a466-c2f2beaa681b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02d04f6-ff39-4236-b2b9-9e02c48cb76a", "name": "network-vif-plugged", "status": "completed", "tag": "4c5945a2-55a0-4db1-828c-6ff9fc4d020f"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:25.212614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-660a39fb-86da-42ba-ace2-3a78cf739f4a req-305ef33b-7d03-4aff-a466-c2f2beaa681b service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:25.213320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-660a39fb-86da-42ba-ace2-3a78cf739f4a req-305ef33b-7d03-4aff-a466-c2f2beaa681b service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:25.232030 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-660a39fb-86da-42ba-ace2-3a78cf739f4a req-305ef33b-7d03-4aff-a466-c2f2beaa681b service nova] Creating event network-vif-plugged:4c5945a2-55a0-4db1-828c-6ff9fc4d020f for instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a on hv-cinder-82099 Jul 19 13:05:25.239910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-660a39fb-86da-42ba-ace2-3a78cf739f4a req-305ef33b-7d03-4aff-a466-c2f2beaa681b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047484 Jul 19 13:05:25.241520 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 846/1833] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 13:05:25.342033 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:25.350729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:25.352546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:25.353823 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5a529671-1fa4-4fec-960b-21a74644c3c0 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.436160 Jul 19 13:05:25.363621 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 988/1834] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:24 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:26.679382 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:26.680070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:26.694198 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:26.695407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:26.696389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:26.697089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:26.850243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:26.859805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:26.861524 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:26.862931 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-21b5aecb-b97f-4cc7-8d2f-7eb38c477909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.491737 Jul 19 13:05:26.863489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 847/1835] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:26 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:27.884079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:27.885134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:27.891551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:27.892015 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:27.892828 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:27.893520 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:28.061617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:28.065699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:28.067215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:28.068387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb855f07-d0e3-455a-a9d8-2d257a870085 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.190495 Jul 19 13:05:28.069097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 989/1836] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:27 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:29.086900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:29.087678 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:29.099882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:29.100383 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:29.101173 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:29.101613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:29.105801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:29.242775 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:29.254834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:29.256714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:29.257987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-30a17658-1bf5-43ae-8ef6-4d35d44fb75a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.175092 Jul 19 13:05:29.269340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 848/1837] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:29 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:30.278563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:30.279164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:30.286116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:30.286579 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:30.287355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:30.287794 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:30.435312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:30.444057 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:30.445649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:30.446887 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b306feaa-1227-4c0e-a5fd-f2c8b2207f0f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.173068 Jul 19 13:05:30.447468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 990/1838] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:30 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:31.465979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:31.466610 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:31.474287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:31.475906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:31.476789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:31.477448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:31.639264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:31.648959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:31.650845 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:31.652169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-568c901a-3184-42f7-ae4d-4f892cccc909 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.190236 Jul 19 13:05:31.653277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 849/1839] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:31 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:32.670609 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:32.671848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:32.680523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:32.682517 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:32.684923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:32.685551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:32.690060 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:32.843400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:32.852606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:32.854248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:32.855456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-68fcab7a-1f3f-4b0a-baec-0879d18fe610 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.188730 Jul 19 13:05:32.860221 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 991/1840] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:32 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:33.875105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:33.876501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:33.885848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:33.886272 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:33.887069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:33.887516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:34.021218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:34.029520 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:34.031041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:34.032219 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7c909e17-c84b-4059-878d-c45915d6015a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.162596 Jul 19 13:05:34.032783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 850/1841] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:33 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:35.050846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:35.051456 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:35.058584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:35.059038 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:35.059802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:35.060264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:35.185953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:35.193897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:35.195341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:35.196538 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f881ce0-709c-4ca1-afa5-5d17620a84be tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.149527 Jul 19 13:05:35.197095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 992/1842] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:35 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:36.216040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:36.217370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:36.223637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:36.224093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:36.224933 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:36.225414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:36.356869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:36.365036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:36.366774 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:36.367921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4f2cdbb8-66a5-4a8b-9f0f-62a61f3843a1 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1738 microversion: 2.20 time: 0.157184 Jul 19 13:05:36.368516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 851/1843] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:36 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 13:05:37.387606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:37.388239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:37.390435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=39 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:37.396528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:37.397115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:37.397932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:37.398375 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:37.531171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:37.539064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:37.540589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:37.541765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fef73c64-73ea-429d-9c9b-9e9d60941998 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1720 microversion: 2.20 time: 0.158800 Jul 19 13:05:37.542318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 993/1844] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:37 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:38.561961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:38.562587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:38.568343 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:38.570224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:38.570684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:38.571502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:38.572163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:38.712756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:38.721038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:38.722588 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:38.723716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f7eba33c-355c-4f0c-9f22-cfb3b224d203 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1720 microversion: 2.20 time: 0.167093 Jul 19 13:05:38.724299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 852/1845] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:38 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 13:05:39.165070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-9107a64d-76a7-4756-b2e2-0a4e2005e955 req-e67fe47b-df0f-46cc-bcaa-05ccefc86915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02d04f6-ff39-4236-b2b9-9e02c48cb76a", "name": "network-vif-unplugged", "status": "completed", "tag": "4c5945a2-55a0-4db1-828c-6ff9fc4d020f"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:39.177504 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-9107a64d-76a7-4756-b2e2-0a4e2005e955 req-e67fe47b-df0f-46cc-bcaa-05ccefc86915 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:39.177989 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-9107a64d-76a7-4756-b2e2-0a4e2005e955 req-e67fe47b-df0f-46cc-bcaa-05ccefc86915 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:39.190450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.compute.server_external_events [req-9107a64d-76a7-4756-b2e2-0a4e2005e955 req-e67fe47b-df0f-46cc-bcaa-05ccefc86915 service nova] Unable to find a host for instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a. Dropping event network-vif-unplugged {{(pid=118120) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 13:05:39.191617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-9107a64d-76a7-4756-b2e2-0a4e2005e955 req-e67fe47b-df0f-46cc-bcaa-05ccefc86915 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030830 Jul 19 13:05:39.192257 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 994/1846] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 13:05:39.741804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:39.742423 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:39.748992 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:39.749449 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:39.750218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:39.750664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:39.884473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:39.892854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:39.894632 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:39.895787 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cbe4ebb1-0393-4970-b503-f05262f49167 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1663 microversion: 2.20 time: 0.157919 Jul 19 13:05:39.896370 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 853/1847] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:39 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:39.913647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5f3be782-da68-4a34-857e-820de2dcaeab tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "242c3ca7-6b40-449e-8326-f1bd747093d4"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:39.914705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5f3be782-da68-4a34-857e-820de2dcaeab tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:39.920707 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3be782-da68-4a34-857e-820de2dcaeab tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:39.921163 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3be782-da68-4a34-857e-820de2dcaeab tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:39.921932 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3be782-da68-4a34-857e-820de2dcaeab tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:39.922399 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3be782-da68-4a34-857e-820de2dcaeab tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.197067 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5f3be782-da68-4a34-857e-820de2dcaeab tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "POST /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287335 Jul 19 13:05:40.197743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 995/1848] 10.222.0.13 () {62 vars in 1363 bytes} [Tue Jul 19 13:05:39 2022] POST /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 13:05:40.312469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-933e3fe9-15ca-4681-8c4a-5f3629d0d0da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:40.312959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-933e3fe9-15ca-4681-8c4a-5f3629d0d0da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:40.318797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-933e3fe9-15ca-4681-8c4a-5f3629d0d0da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.319242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-933e3fe9-15ca-4681-8c4a-5f3629d0d0da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.319994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-933e3fe9-15ca-4681-8c4a-5f3629d0d0da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.320458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-933e3fe9-15ca-4681-8c4a-5f3629d0d0da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.516801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:40.517380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:40.524773 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.525228 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.526001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.526438 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.569253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-933e3fe9-15ca-4681-8c4a-5f3629d0d0da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-volume_attachments/242c3ca7-6b40-449e-8326-f1bd747093d4" status: 202 len: 0 microversion: 2.20 time: 0.261186 Jul 19 13:05:40.569881 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 854/1849] 10.222.0.13 () {60 vars in 1456 bytes} [Tue Jul 19 13:05:40 2022] DELETE /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-volume_attachments/242c3ca7-6b40-449e-8326-f1bd747093d4 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 13:05:40.611985 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'services' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:40.631385 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4fa6eefd-62f6-4588-8c0e-626f3b6e77a5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:40.631954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4fa6eefd-62f6-4588-8c0e-626f3b6e77a5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:40.638609 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fa6eefd-62f6-4588-8c0e-626f3b6e77a5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.639057 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fa6eefd-62f6-4588-8c0e-626f3b6e77a5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.639813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fa6eefd-62f6-4588-8c0e-626f3b6e77a5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.640456 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4fa6eefd-62f6-4588-8c0e-626f3b6e77a5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.686508 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6c307ac-7dac-43bf-a1f5-09a6072d0d89 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39/os-volume_attachments/d51958fc-ecd0-4d58-9f71-aa31dc5563ba" status: 202 len: 0 microversion: 2.1 time: 0.173542 Jul 19 13:05:40.687109 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 996/1850] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 13:05:40 2022] DELETE /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39/os-volume_attachments/d51958fc-ecd0-4d58-9f71-aa31dc5563ba => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:05:40.749096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4fa6eefd-62f6-4588-8c0e-626f3b6e77a5 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "POST /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/action" status: 202 len: 0 microversion: 2.20 time: 0.121273 Jul 19 13:05:40.750230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 855/1851] 10.222.0.13 () {62 vars in 1318 bytes} [Tue Jul 19 13:05:40 2022] POST /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 13:05:40.762495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:40.763710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:40.771529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.777010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.779402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:40.780071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:40.917279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:40.926827 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:40.928352 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:40.929495 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-88541aff-45cb-4929-8f57-8b1987c4a2f8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1671 microversion: 2.20 time: 0.174072 Jul 19 13:05:40.930054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 997/1852] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:40 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:41.837976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:41.838533 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:41.845253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:41.845710 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:41.846472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:41.847373 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:41.873240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Going to try to terminate instance {{(pid=118119) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:05:41.946837 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3028b5fe-f149-40c8-9121-bf521f290519 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 204 len: 0 microversion: 2.1 time: 0.112914 Jul 19 13:05:41.947324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:41.947953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:41.948279 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 856/1853] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:05:41 2022] DELETE /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 13:05:41.954622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:41.955171 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:41.956163 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:41.956784 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:41.956964 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:41.957487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:41.963420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:41.963879 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:41.964671 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:41.965107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:42.142353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:42.150696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:42.152391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:42.153667 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-642dde02-dce6-4efd-963d-e788857865d8 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.210528 Jul 19 13:05:42.154754 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 998/1854] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:41 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:42.157013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:42.165585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b4ab2357-a7b5-457f-adcf-7537be48fac1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1513 microversion: 2.1 time: 0.213057 Jul 19 13:05:42.166169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 857/1855] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:41 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:05:43.172202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:43.172815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:43.179675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:43.180126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:43.180936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:43.181377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:43.184414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:43.185029 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:43.191323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:43.191778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:43.192570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:43.193011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:43.383877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:43.385527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:43.391910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bcc4ed14-63c0-45d5-977e-29f05afb190f tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1513 microversion: 2.1 time: 0.211707 Jul 19 13:05:43.392534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 858/1856] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:43 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:05:43.393724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:43.395222 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:43.396622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9b9154c-0304-47e3-9f71-1b1bcc91fff6 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.228095 Jul 19 13:05:43.397079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 999/1857] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:43 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:44.185832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-355d6da5-1cce-40d9-a177-2f34abd718b8 req-bc78c930-48a7-40b8-98e2-3db40bb44237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6553d3-ea99-43a1-a5f0-dab08319ca39", "name": "network-vif-deleted", "tag": "6ad9c929-8c66-4b3a-be74-3cdbe6bb2f38"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:05:44.196432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-355d6da5-1cce-40d9-a177-2f34abd718b8 req-bc78c930-48a7-40b8-98e2-3db40bb44237 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:44.197656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-355d6da5-1cce-40d9-a177-2f34abd718b8 req-bc78c930-48a7-40b8-98e2-3db40bb44237 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:44.210323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-355d6da5-1cce-40d9-a177-2f34abd718b8 req-bc78c930-48a7-40b8-98e2-3db40bb44237 service nova] Creating event network-vif-deleted:6ad9c929-8c66-4b3a-be74-3cdbe6bb2f38 for instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 on hv-cinder-82099 Jul 19 13:05:44.216874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-355d6da5-1cce-40d9-a177-2f34abd718b8 req-bc78c930-48a7-40b8-98e2-3db40bb44237 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034702 Jul 19 13:05:44.217464 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 859/1858] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:05:44.410127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:44.410835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:44.415410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:44.416305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:44.423663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:44.423955 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:44.424631 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:44.425199 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:44.426369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:44.427056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:44.427487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:44.427772 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:44.448413 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:44.495671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:44.496691 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:44.497605 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:44.562711 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:44.575738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c7bbe60-dc8e-4db8-8e49-1bead828de6a tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.169655 Jul 19 13:05:44.585834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1000/1859] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:44 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:44.664627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:44.675192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:44.676925 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:44.678136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-51f02837-b2ea-4d47-87b6-c6d0735ee96b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.267383 Jul 19 13:05:44.678913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 860/1860] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:44 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:45.593490 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:45.594246 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:45.610498 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:45.611226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:45.612387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:45.612999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:45.645718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:45.646502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:45.647184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:45.689251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:45.696651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:45.697134 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94b0576f-2570-4f62-874e-23167e04fa76 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.107869 Jul 19 13:05:45.697319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:45.698120 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1001/1861] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:45 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:45.704346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:45.704809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:45.705582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:45.706022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:45.848170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:45.856085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:45.857631 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:45.858801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fad2dc17-304d-4192-bd8f-4b46e53eb67f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.166123 Jul 19 13:05:45.859367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 861/1862] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:45 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 13:05:46.713901 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:46.715839 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:46.722977 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:46.723736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:46.724723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:46.725494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:46.758339 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:46.758859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:46.759314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:46.804780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:46.813136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6aa3558-b64b-4c02-b79f-fbc800c45cf1 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.103070 Jul 19 13:05:46.813938 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1002/1863] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:46 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:46.876625 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:46.877900 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:46.884425 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:46.884880 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:46.885653 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:46.886085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:47.030241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:47.039058 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:47.040987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:47.042813 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-caa65190-9abf-4ebd-accb-1c53a5136876 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.170302 Jul 19 13:05:47.044395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 862/1864] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:46 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:47.830523 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:47.831821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:47.839130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:47.839984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:47.841133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:47.841752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:47.876306 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:47.877021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:47.877472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:47.918243 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:47.921752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:05:47.926586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b294017a-f455-4a1b-98ce-850f170cd954 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.099751 Jul 19 13:05:47.927197 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1003/1865] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:47 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:48.062548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:48.063163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:48.069834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:48.070412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:48.071195 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:48.071644 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:48.213829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:48.222647 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:48.224191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:48.225390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-daaf5ff1-880f-4ef9-abb9-5f8fde11a489 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.167386 Jul 19 13:05:48.237239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 863/1866] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:48 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:48.947484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:48.948116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:48.957592 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:48.958017 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:48.958528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:48.959290 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:48.994089 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:48.994543 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:48.995001 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:49.038383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:49.048936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-92210f62-234b-4a30-8b54-5ba40e791ab4 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.107918 Jul 19 13:05:49.050201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1004/1867] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:48 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:49.246269 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:49.248326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:49.257138 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:49.258271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:49.264098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:49.264829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:49.399529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:49.407541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:49.409071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:49.410222 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7cb68a2c-e8c3-46c6-bcde-cd9f261002e9 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.169570 Jul 19 13:05:49.410793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 864/1868] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:49 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:50.066788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:50.068121 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:50.076100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:50.076849 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:50.077818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:50.078425 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:50.110857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:50.111316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:50.111768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:50.153527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:50.164314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4ee8a378-953c-4d8d-b242-eea831fa7037 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.101202 Jul 19 13:05:50.165285 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1005/1869] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:50 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:05:50.430346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:50.430978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:50.437958 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:50.438409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:50.439163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:50.439596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:50.590882 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:50.598989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:50.600576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:50.601894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-78d367d6-ad4a-496b-8979-f2dd448e173f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.175450 Jul 19 13:05:50.602484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 865/1870] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:50 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:51.182421 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:51.183030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:51.189806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:51.190726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:51.191888 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:51.192655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:51.227757 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:51.228266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:51.228714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:51.272298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:51.280066 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb79c30a-5ddb-4013-9afd-1855de9e0508 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.101727 Jul 19 13:05:51.280699 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1006/1871] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:51 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:51.621645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:51.622396 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:51.629118 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:51.629581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:51.630368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:51.630807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:51.769793 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:51.778152 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:51.779729 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:51.780927 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1570aac1-d97c-4e23-8b45-149b7ac21372 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.163832 Jul 19 13:05:51.781508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 866/1872] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:51 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:52.297909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:52.298532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:52.304928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:52.305378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:52.306133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:52.306568 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:52.335463 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:52.335903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:52.336383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:52.376936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:52.384238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5af66e83-fd2b-43d8-bacf-2e424f379423 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.090329 Jul 19 13:05:52.384796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1007/1873] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:52 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:52.799123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:52.799735 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:52.806446 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:52.806930 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:52.807701 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:52.808741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:52.936320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:52.944265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:52.945768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:52.946914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dfb02af6-bbd8-4c46-9e9d-0a8d695e1a30 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.151668 Jul 19 13:05:52.947473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 867/1874] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:52 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:53.401682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:53.402910 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:53.409378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:53.409832 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:53.410594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:53.411032 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:53.440013 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:53.440489 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:53.440934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:53.481351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:53.488597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b5d1ad4-c963-4a5d-9dcf-1d75088db79d tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.090786 Jul 19 13:05:53.489164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1008/1875] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:53 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:53.965200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:53.965819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:53.972271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:53.972746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:53.973514 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:53.973961 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:54.106570 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:54.114314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:54.115819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:54.117003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c87bdcc6-efd5-410a-af77-5cfc963003d2 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.155757 Jul 19 13:05:54.117581 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 868/1876] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:53 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:54.505716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:54.506353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:54.513386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:54.513830 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:54.514588 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:54.515020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:54.546487 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:54.546939 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:54.547381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lazy-loading 'fault' on Instance uuid ff6553d3-ea99-43a1-a5f0-dab08319ca39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:05:54.590941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c035662359493e86c58a3d40150eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6b44bed4904d50b5f1ebfc5ab34743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:54.598964 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b1285a4e-2ce9-4121-81ba-6596118b131e tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 200 len: 1309 microversion: 2.1 time: 0.097062 Jul 19 13:05:54.599570 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1009/1877] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:54 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:05:55.134575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:55.135191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:55.142013 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:55.142469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:55.143489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:55.143929 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:55.190634 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:05:55.190634 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:05:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a (ip 10.222.0.13) !!! Jul 19 13:05:55.272428 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:55.280763 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:55.282273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:55.283422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c9f83239-ab10-464e-b6d4-f3df721c936e tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.152687 Jul 19 13:05:55.283991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 869/1878] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:55 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:55.616327 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:55.616944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] [instance: ff6553d3-ea99-43a1-a5f0-dab08319ca39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:55.623350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:55.623797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:55.624598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:55.625035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:55.640535 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] HTTP exception thrown: Instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 could not be found. Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Request method failure captured: Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 HTTP/1.1 Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRwhCWuxwtHqwEaWtIpriGmsmHCGOtoB3kM1ahNyEIPaY7p7NIZkU5evHjcQ8k3Q8zGT8qYqoPLvIBbWOSvyYEoeWFvbswBeyLwlaUpKaN3BmI01RVK8t24CrN8FTpn8uOceTpuVxBtXjoQ1f5AtEPiSZDMdfCyRrYN9HGrsigEkL0 Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:05:55.642144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f6b44bed4904d50b5f1ebfc5ab34743", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f6b44bed4904d50b5f1ebfc5ab34743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 6f6b44bed4904d50b5f1ebfc5ab34743 Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2139835404 Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 70c035662359493e86c58a3d40150eb8 Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-2139835404-project Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 could not be found. Jul 19 13:05:55.644226 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'ff6553d3-ea99-43a1-a5f0-dab08319ca39'} Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 could not be found. Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:05:55.645113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 could not be found. Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 could not be found. Jul 19 13:05:55.646524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:05:55.647806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] Returning 404 to user: Instance ff6553d3-ea99-43a1-a5f0-dab08319ca39 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:05:55.647806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cfa3218f-82f2-46e7-ab80-577609e43162 tempest-VolumesSnapshotTestJSON-2139835404 tempest-VolumesSnapshotTestJSON-2139835404-project] 10.222.0.13 "GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39" status: 404 len: 111 microversion: 2.1 time: 0.031372 Jul 19 13:05:55.647806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1010/1879] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:05:55 2022] GET /compute/v2.1/servers/ff6553d3-ea99-43a1-a5f0-dab08319ca39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:05:56.302002 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:56.302619 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:56.309646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:56.310100 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:56.310865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:56.311303 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:56.436458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:56.444189 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:56.445705 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:56.446843 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8406e8f2-f808-488a-982f-37f11a4302da tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.148857 Jul 19 13:05:56.447399 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 870/1880] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:56 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:57.464768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:57.465370 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:57.471809 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:57.472287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:57.473042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:57.473471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:57.599051 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:57.607458 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:57.609030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:57.610199 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19378286-9679-41a8-a594-99ab6cd224db tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.149359 Jul 19 13:05:57.610996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1011/1881] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:57 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:58.628829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:58.629441 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:58.635836 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:58.636543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:58.637312 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:58.637749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:58.767896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:58.775908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:58.777952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:58.779091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-25264ce3-5db7-4220-8c8c-77358b841309 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.154157 Jul 19 13:05:58.779648 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 871/1882] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:58 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:05:59.796852 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:05:59.797451 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:05:59.803900 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:59.804389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:59.805143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:05:59.805573 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:05:59.931534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:59.939982 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:59.941503 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:05:59.942650 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-692c637c-b291-44a7-8631-10af4469600a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.149661 Jul 19 13:05:59.943192 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1012/1883] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:05:59 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:00.960690 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:00.961247 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:00.968136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:00.968618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:00.969378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:00.969817 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:01.096687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:01.104527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:01.106565 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:01.107712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ba4de49c-024a-4818-8ea7-606cc6c45538 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.150988 Jul 19 13:06:01.108289 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 872/1884] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:00 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:02.126348 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:02.126997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:02.133586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:02.134049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:02.134825 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:02.135267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:02.163254 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-7ebe8937-85de-44dc-8530-51037635e47c req-17148a4b-4fa2-4843-a7b4-4b48919d4ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02d04f6-ff39-4236-b2b9-9e02c48cb76a", "name": "network-vif-plugged", "status": "completed", "tag": "4c5945a2-55a0-4db1-828c-6ff9fc4d020f"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:06:02.172726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-7ebe8937-85de-44dc-8530-51037635e47c req-17148a4b-4fa2-4843-a7b4-4b48919d4ee7 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:02.173208 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-7ebe8937-85de-44dc-8530-51037635e47c req-17148a4b-4fa2-4843-a7b4-4b48919d4ee7 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:02.186442 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-7ebe8937-85de-44dc-8530-51037635e47c req-17148a4b-4fa2-4843-a7b4-4b48919d4ee7 service nova] Creating event network-vif-plugged:4c5945a2-55a0-4db1-828c-6ff9fc4d020f for instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a on hv-cinder-82099 Jul 19 13:06:02.191731 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-7ebe8937-85de-44dc-8530-51037635e47c req-17148a4b-4fa2-4843-a7b4-4b48919d4ee7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031860 Jul 19 13:06:02.192367 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 873/1885] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 13:06:02.283029 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:02.291894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:02.293963 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:02.295143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a1f6a0f-1032-42f2-8406-9409d73784f4 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.172670 Jul 19 13:06:02.295706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1013/1886] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:02 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:03.314398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:03.315106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:03.321482 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:03.321924 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:03.322694 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:03.323135 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:03.458476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:03.467055 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:03.468665 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:03.469811 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e4899e2c-980b-4801-b8a9-0575dbdfc14b tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1729 microversion: 2.20 time: 0.160220 Jul 19 13:06:03.470374 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 874/1887] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:03 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:04.488094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:04.488749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:04.495184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:04.495638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:04.496437 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:04.496878 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:04.630776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:04.639264 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:04.640810 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:04.641975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0dc6abf-fcb9-4d62-8d4a-47ba9fe2f628 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1716 microversion: 2.20 time: 0.157825 Jul 19 13:06:04.642539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1014/1888] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:04 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:14.288877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:06:14.289509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:06:26.673869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:26.674403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:26.677797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:26.678445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=83 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:26.684576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:26.685372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:26.686443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:26.686891 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:26.701415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 HTTP/1.1 Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:06:26.703064 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.704894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3'} Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:06:26.705788 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.707205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.708642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:06:26.708642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-49ade762-f53f-4f8b-b6fd-4c4c428ce51b tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 404 len: 111 microversion: 2.1 time: 0.034361 Jul 19 13:06:26.708642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 875/1889] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:06:26 2022] DELETE /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:06:26.712898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:26.713566 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] [instance: dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:26.717220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=63 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:26.717866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=74 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:26.722536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:26.722995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:26.723769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:26.724236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:26.737984 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] HTTP exception thrown: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Request method failure captured: Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 HTTP/1.1 Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qRi7W4VA9y27ThwmtO1bwPjuz6ANb38cqpKT6u8Wg6sDrDG1DD-G7etz6FiIcFGCCx_cEmrqjTGXj4wmuKGDbrtF6YZKbT1gBOdACVCNUdI03EXiWmSLHXyO_fPmah-DqOz56N_z_xYCvVJpmyI4vcZ5LqEVA63nxwCjQikjjYjNOA Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:06:26.739494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3528f0d517e54016ab254ca0a3c11693", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3528f0d517e54016ab254ca0a3c11693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3528f0d517e54016ab254ca0a3c11693 Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279493292 Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 1a1284271e83435aa6fd851d6106e3a8 Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-279493292-project Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.741251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3'} Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:06:26.742128 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. Jul 19 13:06:26.743468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:26.744728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] Returning 404 to user: Instance dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:06:26.744728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1563a3d9-66b0-4bad-bca3-6743866f5f89 tempest-AttachVolumeNegativeTest-279493292 tempest-AttachVolumeNegativeTest-279493292-project] 10.222.0.13 "GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3" status: 404 len: 111 microversion: 2.1 time: 0.031935 Jul 19 13:06:26.744728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1015/1890] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:06:26 2022] GET /compute/v2.1/servers/dd4a2fa1-c386-458c-bfb6-1b40ebd58ec3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:06:43.025952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-905bddf6-9382-4506-a530-793074c4007d tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:43.027094 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-905bddf6-9382-4506-a530-793074c4007d tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:43.030127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:43.031060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:43.037170 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-905bddf6-9382-4506-a530-793074c4007d tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:43.037714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-905bddf6-9382-4506-a530-793074c4007d tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:43.038596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-905bddf6-9382-4506-a530-793074c4007d tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:43.039270 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-905bddf6-9382-4506-a530-793074c4007d tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:43.069667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-905bddf6-9382-4506-a530-793074c4007d tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048451 Jul 19 13:06:43.070544 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 876/1891] 10.222.0.13 () {60 vars in 1342 bytes} [Tue Jul 19 13:06:43 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:06:43.131359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:43.132464 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:43.138996 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:43.139674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:06:43.141875 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:43.142534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:43.143765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:43.144447 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:43.182731 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:06:43.282422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7e57f53c-0c77-44b1-96bf-d93b26559f6f tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 204 len: 0 microversion: 2.20 time: 0.155043 Jul 19 13:06:43.283230 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1016/1892] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jul 19 13:06:43 2022] DELETE /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 13:06:43.291212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:43.291822 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:43.298601 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:43.299332 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:43.300752 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:43.301445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:43.465461 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:43.474636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:43.476126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:43.477314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-65dac836-49ec-44d5-be7b-359d929c5f60 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.189923 Jul 19 13:06:43.493271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 877/1893] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:43 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:44.501302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:44.501999 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:44.514418 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:44.514857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:44.515634 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:44.516074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:44.734158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:44.745838 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:44.749283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:44.751285 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a12875b9-4b20-428d-ae1e-f64f7b7ae332 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1722 microversion: 2.20 time: 0.255745 Jul 19 13:06:44.753162 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1017/1894] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:44 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:45.771151 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:45.771800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:45.778742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:45.780027 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:45.781187 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:45.781736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:45.886743 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:45.897798 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:45.903223 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ebf48bf50b455fa85d3e7ad9164a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c364ae782cdb4e43ad3dd6f4dddc9520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:06:45.906851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fc05c156-dd2f-451e-8f83-e9e0223a2707 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 200 len: 1655 microversion: 2.20 time: 0.141065 Jul 19 13:06:45.908477 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 878/1895] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:45 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 1655 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 13:06:46.129959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-6ece4ff2-9199-4a89-8194-496602c13f06 req-e1d26ae5-c601-4b6c-8574-832ac2ed1466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02d04f6-ff39-4236-b2b9-9e02c48cb76a", "name": "network-vif-deleted", "tag": "4c5945a2-55a0-4db1-828c-6ff9fc4d020f"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:06:46.142481 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-6ece4ff2-9199-4a89-8194-496602c13f06 req-e1d26ae5-c601-4b6c-8574-832ac2ed1466 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:46.142869 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-6ece4ff2-9199-4a89-8194-496602c13f06 req-e1d26ae5-c601-4b6c-8574-832ac2ed1466 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:46.162472 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-6ece4ff2-9199-4a89-8194-496602c13f06 req-e1d26ae5-c601-4b6c-8574-832ac2ed1466 service nova] Creating event network-vif-deleted:4c5945a2-55a0-4db1-828c-6ff9fc4d020f for instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a on hv-cinder-82099 Jul 19 13:06:46.169200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-6ece4ff2-9199-4a89-8194-496602c13f06 req-e1d26ae5-c601-4b6c-8574-832ac2ed1466 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043213 Jul 19 13:06:46.176468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1018/1896] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:06:46.926791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:46.927180 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:46.938337 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:46.940831 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:46.941666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:46.942110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:46.973079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] HTTP exception thrown: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Request method failure captured: Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a HTTP/1.1 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qmOsIxYGKVkVvCQ0X0RdjSqKGakTh9dUnQ4xZ_Hf0fzBWdxzU1C1ny0aKeTR8-C2Lkr1PdHr0NZ62bnrtOdE5UmfyOLQxqLgzAyLkFm5rz6paNdZdyKYHawSN2iYevvk06JR32AkFXukCjI9EbBTH7HTIVno5VPQYoGUDogK_TRQs4 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:06:46.974650 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c364ae782cdb4e43ad3dd6f4dddc9520", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 93ebf48bf50b455fa85d3e7ad9164a04 Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:46.976530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'a02d04f6-ff39-4236-b2b9-9e02c48cb76a'} Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:06:46.977936 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:46.979695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:46.982732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Returning 404 to user: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:06:46.982732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7b319456-d2f3-4945-b077-2446adfe6849 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 404 len: 111 microversion: 2.20 time: 0.053598 Jul 19 13:06:46.982732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 879/1897] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:46 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 13:06:46.991676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00a4cce5-fb03-4dd7-94d8-9b65bb9770cc tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '.version_select at 0x7fd9943d9550>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:47.019168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-00a4cce5-fb03-4dd7-94d8-9b65bb9770cc tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-534692270" status: 204 len: 0 microversion: 2.20 time: 0.031687 Jul 19 13:06:47.020567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1019/1898] 10.222.0.13 () {60 vars in 1258 bytes} [Tue Jul 19 13:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-534692270 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 13:06:49.417369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:49.417910 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:49.425991 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:49.426457 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:49.427438 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:49.427888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:49.443955 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] HTTP exception thrown: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Request method failure captured: Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a HTTP/1.1 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qmOsIxYGKVkVvCQ0X0RdjSqKGakTh9dUnQ4xZ_Hf0fzBWdxzU1C1ny0aKeTR8-C2Lkr1PdHr0NZ62bnrtOdE5UmfyOLQxqLgzAyLkFm5rz6paNdZdyKYHawSN2iYevvk06JR32AkFXukCjI9EbBTH7HTIVno5VPQYoGUDogK_TRQs4 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:06:49.446140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c364ae782cdb4e43ad3dd6f4dddc9520", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 93ebf48bf50b455fa85d3e7ad9164a04 Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.448045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'a02d04f6-ff39-4236-b2b9-9e02c48cb76a'} Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:06:49.449378 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.450995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.452726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Returning 404 to user: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:06:49.452726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-56a622cf-2b58-4c37-85ae-2c8f9bb79a4a tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 404 len: 111 microversion: 2.20 time: 0.034662 Jul 19 13:06:49.452726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 880/1899] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jul 19 13:06:49 2022] DELETE /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 13:06:49.459139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:49.459979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: a02d04f6-ff39-4236-b2b9-9e02c48cb76a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:49.468298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:49.469104 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:49.469975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:49.470492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:49.492284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] HTTP exception thrown: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Request method failure captured: Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a HTTP/1.1 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qmOsIxYGKVkVvCQ0X0RdjSqKGakTh9dUnQ4xZ_Hf0fzBWdxzU1C1ny0aKeTR8-C2Lkr1PdHr0NZ62bnrtOdE5UmfyOLQxqLgzAyLkFm5rz6paNdZdyKYHawSN2iYevvk06JR32AkFXukCjI9EbBTH7HTIVno5VPQYoGUDogK_TRQs4 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:06:49.494533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c364ae782cdb4e43ad3dd6f4dddc9520", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 93ebf48bf50b455fa85d3e7ad9164a04 Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.496470 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'a02d04f6-ff39-4236-b2b9-9e02c48cb76a'} Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:06:49.498054 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. Jul 19 13:06:49.499708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:49.502180 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Returning 404 to user: Instance a02d04f6-ff39-4236-b2b9-9e02c48cb76a could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:06:49.503216 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce2be6bc-ced1-4799-937f-212de64336ed tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a" status: 404 len: 111 microversion: 2.20 time: 0.049404 Jul 19 13:06:49.504393 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1020/1900] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:49 2022] GET /compute/v2.1/servers/a02d04f6-ff39-4236-b2b9-9e02c48cb76a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 13:06:50.664590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:50.665821 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:50.674667 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:50.675354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:50.676880 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:50.677505 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:50.712165 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] HTTP exception thrown: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Request method failure captured: Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd HTTP/1.1 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qmOsIxYGKVkVvCQ0X0RdjSqKGakTh9dUnQ4xZ_Hf0fzBWdxzU1C1ny0aKeTR8-C2Lkr1PdHr0NZ62bnrtOdE5UmfyOLQxqLgzAyLkFm5rz6paNdZdyKYHawSN2iYevvk06JR32AkFXukCjI9EbBTH7HTIVno5VPQYoGUDogK_TRQs4 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:06:50.714124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c364ae782cdb4e43ad3dd6f4dddc9520", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 93ebf48bf50b455fa85d3e7ad9164a04 Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.715963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'beddcf3c-9050-464a-ae8b-6e09f54bd9cd'} Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:06:50.717284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.719492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.727572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Returning 404 to user: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:06:50.729508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7b4215da-add2-4a65-ba71-bd6e6d3b5a24 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "DELETE /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 404 len: 111 microversion: 2.20 time: 0.070364 Jul 19 13:06:50.730403 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 881/1901] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jul 19 13:06:50 2022] DELETE /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 13:06:50.740577 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:06:50.742752 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] [instance: beddcf3c-9050-464a-ae8b-6e09f54bd9cd] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:06:50.753335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:50.754634 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:50.756589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:06:50.757541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:06:50.774106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] HTTP exception thrown: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Request method failure captured: Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd HTTP/1.1 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qmOsIxYGKVkVvCQ0X0RdjSqKGakTh9dUnQ4xZ_Hf0fzBWdxzU1C1ny0aKeTR8-C2Lkr1PdHr0NZ62bnrtOdE5UmfyOLQxqLgzAyLkFm5rz6paNdZdyKYHawSN2iYevvk06JR32AkFXukCjI9EbBTH7HTIVno5VPQYoGUDogK_TRQs4 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:06:50.776145 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c364ae782cdb4e43ad3dd6f4dddc9520", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c364ae782cdb4e43ad3dd6f4dddc9520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: c364ae782cdb4e43ad3dd6f4dddc9520 Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-706804442 Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 93ebf48bf50b455fa85d3e7ad9164a04 Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-706804442-project Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.777846 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'beddcf3c-9050-464a-ae8b-6e09f54bd9cd'} Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:06:50.778725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. Jul 19 13:06:50.780824 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:06:50.783420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] Returning 404 to user: Instance beddcf3c-9050-464a-ae8b-6e09f54bd9cd could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:06:50.784622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-435b4483-e4a3-4eec-80b9-e09aa48c3098 tempest-AttachVolumeShelveTestJSON-706804442 tempest-AttachVolumeShelveTestJSON-706804442-project] 10.222.0.13 "GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd" status: 404 len: 111 microversion: 2.20 time: 0.049169 Jul 19 13:06:50.785276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1021/1902] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jul 19 13:06:50 2022] GET /compute/v2.1/servers/beddcf3c-9050-464a-ae8b-6e09f54bd9cd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 13:07:05.015762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=12 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:05.016513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=24 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:05.226371 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c193cbef-16d7-4e1b-9329-35481b7bf68b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'create', calling method: .version_select at 0x7fd994399280>, body: {"keypair": {"name": "tempest-keypair-508292674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9MYE4osyBSrcQecSA0mJiosvxic2P5F6Ql4d1sSwhC5gzT1T89HNUxR2Yd4rIo0r77e2FN0f/3mZKGVew61F8bnH+NOlFnY/76qYLxukg5+h1thZz6ZRJsVgYb/XwUQg=="}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:05.255534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-c193cbef-16d7-4e1b-9329-35481b7bf68b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:07:05.263424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-c193cbef-16d7-4e1b-9329-35481b7bf68b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for user 70ba1847a4044ae6a338cdb4c80af5df and project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:07:05.295380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c193cbef-16d7-4e1b-9329-35481b7bf68b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.285156 Jul 19 13:07:05.296003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 882/1903] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 13:07:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:07.066971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1096515237", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b633f5b-e2eb-45b3-a5b0-525989012ba9"}], "security_groups": [{"name": "tempest-securitygroup--1847312038"}], "key_name": "tempest-keypair-508292674", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:07.076423 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:07.077098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:07.210841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] validate_networks() for [('9b633f5b-e2eb-45b3-a5b0-525989012ba9', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 13:07:07.723075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 13:07:07.723622 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 13:07:07.724235 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 13:07:07.724765 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 13:07:07.725301 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 13:07:07.734895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:07.735476 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:07.736429 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:07.736976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:07.759648 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:07:07.779061 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for user 70ba1847a4044ae6a338cdb4c80af5df and project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:07:07.795584 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 13:07:07.798225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 13:07:07.859427 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c94188b9-7ef1-45ee-bf5a-3481b2908a40 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.797015 Jul 19 13:07:07.865595 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1022/1904] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 13:07:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 13:07:07.870883 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5741daab-29c2-4910-8208-c6ce7888eb89 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:07.872006 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5741daab-29c2-4910-8208-c6ce7888eb89 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:08.015353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5741daab-29c2-4910-8208-c6ce7888eb89 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:08.028799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5741daab-29c2-4910-8208-c6ce7888eb89 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1237 microversion: 2.1 time: 0.160236 Jul 19 13:07:08.034841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 883/1905] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:07 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1237 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:08.848287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-09386cc6-c65a-4a27-95e3-ff38e3684968 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Action: 'create', calling method: .version_select at 0x7fd9944c18b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2145895264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkIF7h7Bnh1KoBtVCZJUu95jKdTWel/NSYXksRSKtm7BmgGzWum4NH/xnIykB2UioaFGVlRZi7k8TuxsZ8uVk8YoEcIAk+5oxkSduO3LsAf82OWFwwXohJRQezbqZQjzA=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:08.879641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-09386cc6-c65a-4a27-95e3-ff38e3684968 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Getting quotas for project 655b99de30324b49b9d33a3f3f4051a8. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:07:08.884533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-09386cc6-c65a-4a27-95e3-ff38e3684968 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Getting quotas for user 03318d8ab40e4aa5b0db0e893c79ec61 and project 655b99de30324b49b9d33a3f3f4051a8. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:07:08.920016 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-09386cc6-c65a-4a27-95e3-ff38e3684968 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.075764 Jul 19 13:07:08.924859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1023/1906] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 13:07:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:09.042578 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-889132608", "imageRef": "4860cd21-a3ac-490c-ba3a-0309bb5f696f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2145895264", "networks": [{"uuid": "2c13ba25-5a93-4f0a-93ed-911fbe5c4fbd"}]}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:09.052317 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:09.053011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:09.062122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:09.062901 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:09.064574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:09.065198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:09.106368 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] validate_networks() for [('2c13ba25-5a93-4f0a-93ed-911fbe5c4fbd', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 13:07:09.254279 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:09.267813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3bec5ba-4f78-49a2-8da0-0f6378f00c5a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1289 microversion: 2.1 time: 0.221524 Jul 19 13:07:09.269018 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1024/1907] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:09 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1289 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:07:10.116897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 13:07:10.118232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 13:07:10.118797 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 13:07:10.119683 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 13:07:10.120583 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 13:07:10.131874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:10.133484 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:10.135137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:10.135915 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:10.165310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Getting quotas for project 655b99de30324b49b9d33a3f3f4051a8. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:07:10.170358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Getting quotas for user 03318d8ab40e4aa5b0db0e893c79ec61 and project 655b99de30324b49b9d33a3f3f4051a8. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:07:10.184651 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 13:07:10.187408 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4860cd21-a3ac-490c-ba3a-0309bb5f696f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 13:07:10.248608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c6e2b242-b08f-4a1d-a7a1-ac4b2cf7852c tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209842 Jul 19 13:07:10.249586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 884/1908] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 13:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 13:07:10.266706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-838da91c-1ce0-41fe-af19-07fcda8f9e7b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:10.267964 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-838da91c-1ce0-41fe-af19-07fcda8f9e7b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:10.295328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:10.304109 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:10.321968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:10.322879 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:10.324627 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:10.325091 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:10.409320 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-838da91c-1ce0-41fe-af19-07fcda8f9e7b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:10.416723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-838da91c-1ce0-41fe-af19-07fcda8f9e7b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1258 microversion: 2.1 time: 0.154962 Jul 19 13:07:10.420630 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1025/1909] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:10 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:10.438605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:10.447009 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2bee1e0e-0a37-42b4-b357-f77c0badf993 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1295 microversion: 2.1 time: 0.163964 Jul 19 13:07:10.450029 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 885/1910] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:10 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1295 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:07:11.437094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:11.438422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:11.465959 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:11.466386 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:11.468208 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:11.469098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:11.473103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:11.473832 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:11.481301 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:11.482110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:11.483261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:11.483914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:11.609076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:11.622721 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4329c43c-5c43-43dd-a091-e5a776112756 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1318 microversion: 2.1 time: 0.190057 Jul 19 13:07:11.624397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1026/1911] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:11 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:11.737972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-3f35a297-697a-4d90-aa54-063bd50a8211 req-091a7a6f-ffdd-4c8c-8376-d0632eaeb743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529d0843-a3f3-4095-8586-1049ce771a18", "tag": "e765ed30-cfc3-4758-86c6-68352e89fcc0"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:11.747241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:11.768588 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1eb4f7a7-6269-40c5-b860-87ba8226daf5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.304677 Jul 19 13:07:11.773513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 886/1912] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:11 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:07:11.774373 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-3f35a297-697a-4d90-aa54-063bd50a8211 req-091a7a6f-ffdd-4c8c-8376-d0632eaeb743 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:11.775249 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-3f35a297-697a-4d90-aa54-063bd50a8211 req-091a7a6f-ffdd-4c8c-8376-d0632eaeb743 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:11.791942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-3f35a297-697a-4d90-aa54-063bd50a8211 req-091a7a6f-ffdd-4c8c-8376-d0632eaeb743 service nova] Creating event network-changed:e765ed30-cfc3-4758-86c6-68352e89fcc0 for instance 529d0843-a3f3-4095-8586-1049ce771a18 on hv-cinder-82099 Jul 19 13:07:11.798346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-3f35a297-697a-4d90-aa54-063bd50a8211 req-091a7a6f-ffdd-4c8c-8376-d0632eaeb743 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064205 Jul 19 13:07:11.799292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1027/1913] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:12.640656 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:12.641285 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:12.648642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:12.649109 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:12.649896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:12.650492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:12.791036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:12.791776 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:12.792499 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:12.800034 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:12.800507 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:12.801293 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:12.801757 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d49d5d4a-238a-4592-bace-ee2b55c2c097 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.164815 Jul 19 13:07:12.801906 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:12.802279 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 887/1914] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:12 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:12.939990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:12.947540 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bca36d94-aa20-417b-9141-75d26ef05eae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.160919 Jul 19 13:07:12.948103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1028/1915] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:12 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:07:13.820551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:13.821424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:13.828205 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:13.828722 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:13.829473 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:13.829916 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:13.964297 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:13.966048 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:13.972912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:13.973583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:13.974882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:13.975512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:13.993421 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:14.010716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-45ba34fa-dc93-4b74-9965-f7313e13cf2e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.195241 Jul 19 13:07:14.020221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 888/1916] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:13 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:14.191935 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:14.203840 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-190b76f7-dc4c-416b-8a7a-90619ede74ed tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.243328 Jul 19 13:07:14.212617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1029/1917] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:13 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:07:15.030819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:15.032078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:15.038734 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:15.039184 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:15.039953 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:15.040655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:15.182937 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:15.191895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-95e48192-cd28-46db-a702-9931b9c3e032 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.164735 Jul 19 13:07:15.194825 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 889/1918] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:15 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:15.221957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:15.222574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:15.228978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:15.229434 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:15.230848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:15.231292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:15.394971 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:15.404070 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4f459bf7-b19a-4fa8-93b8-7fd43a761cad tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.185871 Jul 19 13:07:15.404746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1030/1919] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:15 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:16.208300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:16.208935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:16.216110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:16.216641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:16.217458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:16.217903 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:16.356700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:16.364655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b88ea9fc-d959-4397-9957-cb43df6aa1f3 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.160158 Jul 19 13:07:16.365185 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 890/1920] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:16 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:16.422521 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:16.423136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:16.430351 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:16.431105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:16.432094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:16.432844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:16.613816 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:16.627446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57e33350-c0b3-43e4-8ec2-827272839d00 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.205086 Jul 19 13:07:16.637758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1031/1921] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:16 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:17.383379 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:17.384862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:17.392045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:17.392541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:17.393575 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:17.394078 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:17.525558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:17.533224 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3412fd51-4f32-4c1b-8b48-04229334362b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.154439 Jul 19 13:07:17.543551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 891/1922] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:17 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:17.645714 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:17.646404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:17.653187 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:17.653909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:17.654696 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:17.655305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:17.744576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:17.798907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:17.808046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-393bbf0a-5031-4e6a-ad33-a3fa05bdbe05 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.165315 Jul 19 13:07:17.809819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1032/1923] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:17 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:18.550781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:18.551412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:18.557801 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:18.558849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:18.559614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:18.560046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:18.761077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:18.770020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d6c39804-359f-4f14-8005-2d0d62ced731 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.222942 Jul 19 13:07:18.770648 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 892/1924] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:18 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:18.783143 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-dd73d7bf-aa3e-4ece-add9-557c4fdc79d9 req-88fbffcd-e444-452c-af98-ec87185acea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529d0843-a3f3-4095-8586-1049ce771a18", "name": "network-vif-plugged", "status": "completed", "tag": "e765ed30-cfc3-4758-86c6-68352e89fcc0"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:18.794284 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-dd73d7bf-aa3e-4ece-add9-557c4fdc79d9 req-88fbffcd-e444-452c-af98-ec87185acea5 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:18.794817 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-dd73d7bf-aa3e-4ece-add9-557c4fdc79d9 req-88fbffcd-e444-452c-af98-ec87185acea5 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:18.806449 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-dd73d7bf-aa3e-4ece-add9-557c4fdc79d9 req-88fbffcd-e444-452c-af98-ec87185acea5 service nova] Creating event network-vif-plugged:e765ed30-cfc3-4758-86c6-68352e89fcc0 for instance 529d0843-a3f3-4095-8586-1049ce771a18 on hv-cinder-82099 Jul 19 13:07:18.824662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-dd73d7bf-aa3e-4ece-add9-557c4fdc79d9 req-88fbffcd-e444-452c-af98-ec87185acea5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045364 Jul 19 13:07:18.825882 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1033/1925] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:18.826716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:18.827334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:18.834518 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:18.835579 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:18.836414 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:18.836965 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:18.988558 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:18.996323 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ffc1f217-0bad-4724-b13c-a38b2949eac1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.174381 Jul 19 13:07:18.997326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 893/1926] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:18 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:19.787325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:19.788022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:19.795555 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:19.795986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:19.796780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:19.797275 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:19.951973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:19.959390 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30199847-31b0-405c-8ad0-6bd6b7d2a4c7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.176269 Jul 19 13:07:19.959951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1034/1927] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:19 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:20.013596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:20.014217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:20.021040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:20.021493 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:20.022280 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:20.022748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:20.150093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:20.167123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:20.174998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-79ebf1b0-66ea-4df6-8ef6-10e85dba0ba4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.165784 Jul 19 13:07:20.175560 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 894/1928] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:20 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:20.975907 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:20.976570 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:20.978502 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=12 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:20.984720 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:20.985173 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:20.985940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:20.986377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:21.110814 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:21.118063 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-62a176cf-18f6-4e9d-ab37-de9dcd196451 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.146001 Jul 19 13:07:21.118624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1035/1929] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:20 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:21.191492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:21.192085 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:21.193999 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=12 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:21.199893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:21.200381 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:21.201134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:21.201568 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:21.331599 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:21.339041 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c8e314e9-17a3-4ddb-beec-ec5ca95efc98 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.151344 Jul 19 13:07:21.339608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 895/1930] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:21 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:22.139022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:22.139747 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:22.146859 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:22.147315 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:22.148614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:22.148968 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:22.329724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:22.340563 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a810474f-1329-41ad-b783-07bce91547c8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.205440 Jul 19 13:07:22.343338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1036/1931] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:22 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:22.366617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:22.367232 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:22.378258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:22.387063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:22.389137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:22.389261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:22.449850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-c336c22d-b866-4438-9377-5c67f0321058 req-f625ddf3-41f2-4116-be9e-e94bb7ca6ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afef3a18-c621-48c5-b792-b0bab25edf6c", "tag": "362de188-c5db-46ee-a3d3-bcb4d6f1392b"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:22.468131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-c336c22d-b866-4438-9377-5c67f0321058 req-f625ddf3-41f2-4116-be9e-e94bb7ca6ef2 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:22.468897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-c336c22d-b866-4438-9377-5c67f0321058 req-f625ddf3-41f2-4116-be9e-e94bb7ca6ef2 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:22.499237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-c336c22d-b866-4438-9377-5c67f0321058 req-f625ddf3-41f2-4116-be9e-e94bb7ca6ef2 service nova] Creating event network-changed:362de188-c5db-46ee-a3d3-bcb4d6f1392b for instance afef3a18-c621-48c5-b792-b0bab25edf6c on hv-cinder-82099 Jul 19 13:07:22.509518 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-c336c22d-b866-4438-9377-5c67f0321058 req-f625ddf3-41f2-4116-be9e-e94bb7ca6ef2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072331 Jul 19 13:07:22.510493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1037/1932] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:22.607054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:22.616894 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-842717a4-7667-4edb-8408-c48b99146cb3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1363 microversion: 2.1 time: 0.259203 Jul 19 13:07:22.617483 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 896/1933] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:22 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:23.359793 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:23.360531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:23.366680 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:23.367141 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:23.367909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:23.368379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:23.519324 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:23.526951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-28bbd940-4599-4f5a-924c-8d32252a64dc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.172364 Jul 19 13:07:23.527526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1038/1934] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:23 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:23.633928 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:23.634539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:23.641003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:23.641450 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:23.642235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:23.642669 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:23.775574 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:23.783663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3bc614aa-c85e-489d-8819-bf64cc314e3b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1550 microversion: 2.1 time: 0.153588 Jul 19 13:07:23.784244 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 897/1935] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:23 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:07:23.799949 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-674377b7-0ccf-4355-8dbe-944822ebd3c5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:23.800473 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-674377b7-0ccf-4355-8dbe-944822ebd3c5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:23.806356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674377b7-0ccf-4355-8dbe-944822ebd3c5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:23.806802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674377b7-0ccf-4355-8dbe-944822ebd3c5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:23.807558 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674377b7-0ccf-4355-8dbe-944822ebd3c5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:23.807988 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674377b7-0ccf-4355-8dbe-944822ebd3c5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:23.882654 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-674377b7-0ccf-4355-8dbe-944822ebd3c5 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086442 Jul 19 13:07:23.883254 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1039/1936] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jul 19 13:07:23 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:24.545388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:24.546188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:24.552455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:24.553063 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:24.553986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:24.554480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:25.012554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:25.020066 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f1a16c78-5834-4d7e-a733-3e22d36d0f58 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.479440 Jul 19 13:07:25.020720 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 898/1937] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:24 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:25.156316 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-60149050-b9a4-42c8-b60f-6bc6719701de req-17f3da03-e83d-48fe-9435-904e1ef8f597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529d0843-a3f3-4095-8586-1049ce771a18", "tag": "e765ed30-cfc3-4758-86c6-68352e89fcc0"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:25.164252 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-60149050-b9a4-42c8-b60f-6bc6719701de req-17f3da03-e83d-48fe-9435-904e1ef8f597 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:25.164703 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-60149050-b9a4-42c8-b60f-6bc6719701de req-17f3da03-e83d-48fe-9435-904e1ef8f597 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:25.176465 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-60149050-b9a4-42c8-b60f-6bc6719701de req-17f3da03-e83d-48fe-9435-904e1ef8f597 service nova] Creating event network-changed:e765ed30-cfc3-4758-86c6-68352e89fcc0 for instance 529d0843-a3f3-4095-8586-1049ce771a18 on hv-cinder-82099 Jul 19 13:07:25.181494 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-60149050-b9a4-42c8-b60f-6bc6719701de req-17f3da03-e83d-48fe-9435-904e1ef8f597 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030269 Jul 19 13:07:25.182435 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1040/1938] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:26.037299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:26.037930 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:26.045218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:26.045675 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:26.046460 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:26.046907 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:26.181901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:26.189983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2a421a8e-391e-41d4-b778-c20f5ef327c0 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.156570 Jul 19 13:07:26.190746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 899/1939] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:26 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:27.208600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:27.209308 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:27.215521 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:27.215979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:27.216788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:27.217234 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:27.349912 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:27.357383 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-51eb5ac0-2893-4a5a-a582-e7c47bf91a00 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.153886 Jul 19 13:07:27.357945 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1041/1940] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:27 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:28.374592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:28.375209 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:28.381742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:28.382201 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:28.382979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:28.383422 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:28.518409 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:28.526130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f4a1dcf0-0993-4f39-9891-d2d8389f2e8a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.155423 Jul 19 13:07:28.526706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 900/1941] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:28 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:28.779280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-0b3b29ec-9f5b-4484-b28a-0236f0374660 req-c7651a96-9b2b-43d8-ab23-ade51943b544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afef3a18-c621-48c5-b792-b0bab25edf6c", "name": "network-vif-plugged", "status": "completed", "tag": "362de188-c5db-46ee-a3d3-bcb4d6f1392b"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:28.787928 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0b3b29ec-9f5b-4484-b28a-0236f0374660 req-c7651a96-9b2b-43d8-ab23-ade51943b544 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:28.788405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0b3b29ec-9f5b-4484-b28a-0236f0374660 req-c7651a96-9b2b-43d8-ab23-ade51943b544 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:28.800510 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-0b3b29ec-9f5b-4484-b28a-0236f0374660 req-c7651a96-9b2b-43d8-ab23-ade51943b544 service nova] Creating event network-vif-plugged:362de188-c5db-46ee-a3d3-bcb4d6f1392b for instance afef3a18-c621-48c5-b792-b0bab25edf6c on hv-cinder-82099 Jul 19 13:07:28.805377 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-0b3b29ec-9f5b-4484-b28a-0236f0374660 req-c7651a96-9b2b-43d8-ab23-ade51943b544 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029667 Jul 19 13:07:28.806000 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1042/1942] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:29.542806 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:29.543471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:29.550636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:29.551081 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:29.551835 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:29.552295 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:29.556096 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=100 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:29.683175 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:29.690489 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b8b4e922-05d2-4609-bc5c-0c37662c43f6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1358 microversion: 2.1 time: 0.151570 Jul 19 13:07:29.691056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 901/1943] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:29 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:30.707944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:30.708687 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:30.715014 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:30.715461 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:30.716281 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:30.716716 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:30.848898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:30.856780 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a7119d3-2351-48b5-a8fc-57da56bdfbc6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1548 microversion: 2.1 time: 0.153094 Jul 19 13:07:30.857384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1043/1944] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:30 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:30.873749 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:30.874300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:30.880768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:30.881218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:30.881973 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:30.882407 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:31.017022 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:31.025164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0e2378b2-0cdc-42d5-b3f4-73739aaf6f99 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1548 microversion: 2.1 time: 0.155889 Jul 19 13:07:31.025755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 902/1945] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:30 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:07:31.041206 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:31.045240 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:31.046087 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Searching by: {'deleted': False, 'project_id': '655b99de30324b49b9d33a3f3f4051a8'} {{(pid=118120) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 13:07:31.052866 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:31.053322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:31.054116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:31.054556 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:31.151342 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.multi_cell_list [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 13:07:31.198684 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:31.245951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4ff33ea-214c-404c-81d3-5f41c1a90a6b tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208387 Jul 19 13:07:31.246536 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1044/1946] 10.222.0.13 () {58 vars in 1124 bytes} [Tue Jul 19 13:07:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:31.256914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:31.257531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:31.263944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:31.264432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:31.265185 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:31.265621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:31.393490 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:31.401020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9fb1d439-4acc-4787-baff-f1557b7c67ea tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1548 microversion: 2.1 time: 0.147839 Jul 19 13:07:31.401647 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 903/1947] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:31 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:32.924474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc5406db-8a61-47c3-b64c-b81322d87991 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "960d6e53-cf7a-4ae4-b14e-c50a9612eee4"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:32.925526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc5406db-8a61-47c3-b64c-b81322d87991 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:32.931944 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc5406db-8a61-47c3-b64c-b81322d87991 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:32.932430 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc5406db-8a61-47c3-b64c-b81322d87991 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:32.933185 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc5406db-8a61-47c3-b64c-b81322d87991 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:32.933617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc5406db-8a61-47c3-b64c-b81322d87991 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:33.176200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc5406db-8a61-47c3-b64c-b81322d87991 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255491 Jul 19 13:07:33.176850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1045/1948] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 13:07:32 2022] POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:40.710636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:40.711284 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:40.713265 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:40.718912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:40.719352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:40.720114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:40.720582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:40.850986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:40.859369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2d9826ef-b4f0-4458-8699-2997951cdacd tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1594 microversion: 2.1 time: 0.152728 Jul 19 13:07:40.859974 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 904/1949] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:40 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:42.551261 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:42.555531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-46eb0379-b4fd-4220-a80b-1008e6d4d549 req-060abd38-d920-4854-b66b-dcb44c507d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afef3a18-c621-48c5-b792-b0bab25edf6c", "tag": "362de188-c5db-46ee-a3d3-bcb4d6f1392b"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:42.560953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:07:42.566100 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-46eb0379-b4fd-4220-a80b-1008e6d4d549 req-060abd38-d920-4854-b66b-dcb44c507d51 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:42.566799 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-46eb0379-b4fd-4220-a80b-1008e6d4d549 req-060abd38-d920-4854-b66b-dcb44c507d51 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:42.580038 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-46eb0379-b4fd-4220-a80b-1008e6d4d549 req-060abd38-d920-4854-b66b-dcb44c507d51 service nova] Creating event network-changed:362de188-c5db-46ee-a3d3-bcb4d6f1392b for instance afef3a18-c621-48c5-b792-b0bab25edf6c on hv-cinder-82099 Jul 19 13:07:42.585041 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-46eb0379-b4fd-4220-a80b-1008e6d4d549 req-060abd38-d920-4854-b66b-dcb44c507d51 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035087 Jul 19 13:07:42.586679 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1046/1950] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:07:43.670417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-321593828"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:43.670943 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:43.677613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:43.678066 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:43.678856 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:43.679296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:43.802353 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.network.security_group_api [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Adding security group 12cedb7d-b58b-4a14-a4e7-10f0ce6e0bbe to port 362de188-c5db-46ee-a3d3-bcb4d6f1392b Jul 19 13:07:44.145853 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-28bfcbb5-a38c-456d-ba72-74c1d85ee295 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/action" status: 202 len: 0 microversion: 2.1 time: 0.479031 Jul 19 13:07:44.147093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 905/1951] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:07:43 2022] POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:07:44.157504 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:07:44.158215 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:07:44.166302 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:44.166898 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:44.167751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:44.168340 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:44.369737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:07:44.378334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c62250bc-7783-4bf2-872f-0f62c6ecdf66 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1757 microversion: 2.1 time: 0.226792 Jul 19 13:07:44.378922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1047/1952] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:07:44 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:07:44.600829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-96eaf360-8364-4498-98c3-536f2c630ccf req-1163e4a9-ad86-4b06-b0b0-efc72073ce9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afef3a18-c621-48c5-b792-b0bab25edf6c", "tag": "362de188-c5db-46ee-a3d3-bcb4d6f1392b"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:07:44.609417 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-96eaf360-8364-4498-98c3-536f2c630ccf req-1163e4a9-ad86-4b06-b0b0-efc72073ce9e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:07:44.610140 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-96eaf360-8364-4498-98c3-536f2c630ccf req-1163e4a9-ad86-4b06-b0b0-efc72073ce9e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:07:44.623212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-96eaf360-8364-4498-98c3-536f2c630ccf req-1163e4a9-ad86-4b06-b0b0-efc72073ce9e service nova] Creating event network-changed:362de188-c5db-46ee-a3d3-bcb4d6f1392b for instance afef3a18-c621-48c5-b792-b0bab25edf6c on hv-cinder-82099 Jul 19 13:07:44.628758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-96eaf360-8364-4498-98c3-536f2c630ccf req-1163e4a9-ad86-4b06-b0b0-efc72073ce9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Jul 19 13:07:44.629476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 906/1953] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:08:01.272768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1f4da901-f7e7-4f95-bf71-f0c93d175e59 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:01.273381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1f4da901-f7e7-4f95-bf71-f0c93d175e59 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:01.275763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:01.276436 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:01.282748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f4da901-f7e7-4f95-bf71-f0c93d175e59 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:01.283196 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f4da901-f7e7-4f95-bf71-f0c93d175e59 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:01.283954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f4da901-f7e7-4f95-bf71-f0c93d175e59 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:01.284422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f4da901-f7e7-4f95-bf71-f0c93d175e59 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:01.307515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1f4da901-f7e7-4f95-bf71-f0c93d175e59 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/ips" status: 200 len: 146 microversion: 2.1 time: 0.038547 Jul 19 13:08:01.308065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1048/1954] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 13:08:01 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:08:04.431762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=5 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:04.432537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=28 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:04.436841 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-449e20f4-e633-4369-965d-6e20213bab9f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39232105-ae3e-4901-9571-da12b6fd5d45"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:04.438047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-449e20f4-e633-4369-965d-6e20213bab9f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:04.444939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-449e20f4-e633-4369-965d-6e20213bab9f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:04.445392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-449e20f4-e633-4369-965d-6e20213bab9f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:04.446154 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-449e20f4-e633-4369-965d-6e20213bab9f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:04.446594 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-449e20f4-e633-4369-965d-6e20213bab9f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:04.674913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-449e20f4-e633-4369-965d-6e20213bab9f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244484 Jul 19 13:08:04.675629 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 907/1955] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 13:08:04 2022] POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:08:08.980111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07c88c38-6656-492a-9249-3e40eb0cb31f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:08.981075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07c88c38-6656-492a-9249-3e40eb0cb31f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:08.987010 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07c88c38-6656-492a-9249-3e40eb0cb31f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:08.987457 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07c88c38-6656-492a-9249-3e40eb0cb31f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:08.988225 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07c88c38-6656-492a-9249-3e40eb0cb31f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:08.988658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07c88c38-6656-492a-9249-3e40eb0cb31f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:09.064761 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07c88c38-6656-492a-9249-3e40eb0cb31f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/action" status: 202 len: 0 microversion: 2.1 time: 0.088375 Jul 19 13:08:09.065526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1049/1956] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:08:08 2022] POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:08:09.074921 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:09.076146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:09.082539 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:09.083025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:09.083805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:09.084293 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:09.228978 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:09.236954 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9bfacc8c-ab5d-4172-9f0c-f802a4c1cd7a tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1749 microversion: 2.1 time: 0.167003 Jul 19 13:08:09.237529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 908/1957] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:09 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:10.255881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:10.256619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:10.262796 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:10.263289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:10.264042 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:10.264509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:10.556139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:10.568446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-62e71d79-535c-45dc-8726-42d224cff019 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.316484 Jul 19 13:08:10.569389 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1050/1958] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:10 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:11.101683 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3ee998d4-c7ce-44fb-a556-503f669b2ad4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:11.108662 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ee998d4-c7ce-44fb-a556-503f669b2ad4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:11.109126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-3ee998d4-c7ce-44fb-a556-503f669b2ad4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:11.167219 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-3ee998d4-c7ce-44fb-a556-503f669b2ad4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Going to try to stop instance {{(pid=118119) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 13:08:11.209119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3ee998d4-c7ce-44fb-a556-503f669b2ad4 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action" status: 202 len: 0 microversion: 2.1 time: 0.111169 Jul 19 13:08:11.209724 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 909/1959] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:08:11 2022] POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:08:11.217676 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:11.218366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:11.224914 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:11.225446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:11.226259 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:11.226723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:11.357388 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:11.365273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce7a6a53-0399-489f-93b5-e5f5e1a9fdd2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.151443 Jul 19 13:08:11.365847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1051/1960] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:11 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:11.586025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:11.586732 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:11.593354 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:11.593808 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:11.594571 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:11.595012 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:11.794128 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:11.801946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-659f1373-b37b-45d2-9b7e-e074336c3e9e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.220189 Jul 19 13:08:11.802506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 910/1961] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:11 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:12.382251 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:12.382863 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:12.389886 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:12.390335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:12.391126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:12.391565 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:12.517355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:12.525358 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-81cca596-973e-4f4f-b869-a2cf21cd1c31 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.146961 Jul 19 13:08:12.525913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1052/1962] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:12 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:12.818702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:12.819309 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:12.825700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:12.826147 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:12.826913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:12.827349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:12.968132 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:12.975909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-1ffd9935-4b89-4006-bb41-c44bd4ab13cc tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.161005 Jul 19 13:08:12.976502 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 911/1963] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:12 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:13.542210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:13.542819 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:13.549269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:13.549723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:13.550484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:13.550917 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:13.676422 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:13.684204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7994d07d-d35a-45bc-a02c-883ce1bb6e0a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.145812 Jul 19 13:08:13.684771 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1053/1964] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:13 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:13.992711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:13.993324 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:14.000695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:14.001146 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:14.001896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:14.002329 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:14.146104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:14.153908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-0d823167-eff6-473b-9ffd-8fb493abf1e6 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.165063 Jul 19 13:08:14.154471 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 912/1965] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:13 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:08:14.702305 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:14.702922 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:14.709329 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:14.709786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:14.710551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:14.710992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:14.838050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:14.846515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-985b8cf8-2d03-4670-bd86-bf60d7b0bf2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.148650 Jul 19 13:08:14.847080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1054/1966] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:14 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:15.170964 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:15.171567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:15.178071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:15.178522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:15.179276 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:15.179716 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:15.322366 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:15.331137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-607fe4f8-6f1e-4f7a-8e4a-1059efcca662 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.163949 Jul 19 13:08:15.337912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 913/1967] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:15 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:15.862992 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:15.863603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:15.870176 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:15.870582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:15.871347 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:15.871782 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:16.001220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:16.009117 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52194489-53f0-4eb1-9c74-46ff18df850d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.150418 Jul 19 13:08:16.009745 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1055/1968] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:15 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:16.348912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:16.349523 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:16.355920 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:16.356402 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:16.357164 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:16.357600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:16.496537 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:16.504771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2b786082-deb7-4478-8b08-78b6dd91e720 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.159353 Jul 19 13:08:16.505339 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 914/1969] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:16 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:17.027152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:17.027879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:17.034368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:17.034821 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:17.035583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:17.036022 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:17.169326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:17.177909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fd3558e2-c189-4a70-9278-ac234f55888c tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.154541 Jul 19 13:08:17.178480 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1056/1970] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:17 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:17.521932 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:17.522582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:17.529838 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:17.530778 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:17.531540 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:17.531979 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:17.671661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:17.679550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-88fb31ed-60de-4a84-bc95-940d31aab4b8 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.161690 Jul 19 13:08:17.680119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 915/1971] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:17 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:18.195359 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:18.195972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:18.203031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:18.203485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:18.204269 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:18.204709 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:18.331201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:18.338958 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4011c7e8-765a-48f7-8921-9dfb03b77ee0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.147465 Jul 19 13:08:18.339526 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1057/1972] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:18 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:08:18.695983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:18.696635 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:18.703070 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:18.703519 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:18.704316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:18.704760 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:18.845287 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:18.853212 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-461c97c8-4eab-4252-993b-83e8ad187932 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.161098 Jul 19 13:08:18.853809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 916/1973] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:18 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:19.356050 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:19.356692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:19.363223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:19.363672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:19.364467 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:19.364905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:19.489624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:19.497405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5399045-c36a-494a-a1e1-f72ae7e2e2cc tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.145228 Jul 19 13:08:19.498004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1058/1974] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:19 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:19.870945 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:19.871626 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:19.878585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:19.879046 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:19.879818 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:19.880299 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:20.022478 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:20.030404 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-377da4c4-7c77-4b3f-840e-d5cca442a921 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1754 microversion: 2.1 time: 0.163455 Jul 19 13:08:20.030975 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 917/1975] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:19 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:20.514106 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:20.514717 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:20.521450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:20.521902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:20.522662 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:20.523099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:20.651483 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:20.661139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d643653-f6fe-489e-97b7-27aac725b815 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1724 microversion: 2.1 time: 0.150815 Jul 19 13:08:20.661735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1059/1976] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:20 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:21.046895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:21.047510 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:21.054065 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:21.054531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:21.056328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:21.056328 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:21.197780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:21.206244 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e6fe006c-751f-4053-86bd-24500329cfd7 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1757 microversion: 2.1 time: 0.163194 Jul 19 13:08:21.206805 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 918/1977] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:21 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:21.678942 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:21.679562 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:21.686272 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:21.686726 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:21.688130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:21.688597 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:21.817310 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:21.825155 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf31ccda-cba2-4c16-bf29-c36b12137617 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1701 microversion: 2.1 time: 0.150223 Jul 19 13:08:21.825725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1060/1978] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:21 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1701 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:21.841136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5bb3367d-5455-4e60-aac8-3ee568c365b6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:21.847550 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5bb3367d-5455-4e60-aac8-3ee568c365b6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:21.848005 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5bb3367d-5455-4e60-aac8-3ee568c365b6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:21.869600 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5bb3367d-5455-4e60-aac8-3ee568c365b6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Going to try to start instance {{(pid=118119) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 13:08:21.908815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5bb3367d-5455-4e60-aac8-3ee568c365b6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action" status: 202 len: 0 microversion: 2.1 time: 0.071266 Jul 19 13:08:21.909405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 919/1979] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:08:21 2022] POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:08:21.917326 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:21.917931 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:21.924646 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:21.925107 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:21.925876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:21.926313 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:22.059291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:22.067450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2829bbb6-5c4a-477f-b91c-51fde50e3437 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1710 microversion: 2.1 time: 0.153872 Jul 19 13:08:22.068020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1061/1980] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:21 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:23.085333 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:23.086079 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:23.092319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:23.092780 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:23.094211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:23.094655 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:23.098687 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:23.227326 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:23.235545 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-250d1fdd-294f-4756-8b60-1aed6a6d49fd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1710 microversion: 2.1 time: 0.154942 Jul 19 13:08:23.236112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 920/1981] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:23 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:24.252099 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:24.252737 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:24.259136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:24.259581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:24.260367 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:24.260801 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:24.395909 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:24.403806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e43de13-f8cb-4504-aa1d-5ed94669e888 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1714 microversion: 2.1 time: 0.155533 Jul 19 13:08:24.404395 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1062/1982] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:24 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:53.730504 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-321593828"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:53.731088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:53.733316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=28 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:53.734011 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:53.740526 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:53.740989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:53.741769 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:53.742208 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:53.870748 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.network.security_group_api [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Removing security group 12cedb7d-b58b-4a14-a4e7-10f0ce6e0bbe from port 362de188-c5db-46ee-a3d3-bcb4d6f1392b Jul 19 13:08:54.471153 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-29c603f9-3d36-4e72-adcc-e3e08b25c60e tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/action" status: 202 len: 0 microversion: 2.1 time: 0.744482 Jul 19 13:08:54.471976 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 921/1983] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:08:53 2022] POST /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:08:54.490624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=30 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:54.493524 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:08:54.581679 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-60ef3d5e-9f02-401a-b046-70c86747aed0 req-e9184f33-53c2-4bc5-8189-42c125efa08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afef3a18-c621-48c5-b792-b0bab25edf6c", "tag": "362de188-c5db-46ee-a3d3-bcb4d6f1392b"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:54.594541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-60ef3d5e-9f02-401a-b046-70c86747aed0 req-e9184f33-53c2-4bc5-8189-42c125efa08a service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:54.595268 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-60ef3d5e-9f02-401a-b046-70c86747aed0 req-e9184f33-53c2-4bc5-8189-42c125efa08a service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:54.607229 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-60ef3d5e-9f02-401a-b046-70c86747aed0 req-e9184f33-53c2-4bc5-8189-42c125efa08a service nova] Creating event network-changed:362de188-c5db-46ee-a3d3-bcb4d6f1392b for instance afef3a18-c621-48c5-b792-b0bab25edf6c on hv-cinder-82099 Jul 19 13:08:54.616335 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-60ef3d5e-9f02-401a-b046-70c86747aed0 req-e9184f33-53c2-4bc5-8189-42c125efa08a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131342 Jul 19 13:08:54.617237 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1063/1984] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:08:55.670200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:55.670718 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:55.677587 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:55.678050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:55.679021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:55.679468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:55.758515 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lazy-loading 'services' on Instance uuid afef3a18-c621-48c5-b792-b0bab25edf6c {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:08:55.834107 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-da8dcbbe-9ae7-4e09-a473-9430eeb95504 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments/960d6e53-cf7a-4ae4-b14e-c50a9612eee4" status: 202 len: 0 microversion: 2.1 time: 0.168212 Jul 19 13:08:55.834709 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 922/1985] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 13:08:55 2022] DELETE /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments/960d6e53-cf7a-4ae4-b14e-c50a9612eee4 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:08:55.845482 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b6885335-3054-4308-a372-7202194619a2 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:55.846620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b6885335-3054-4308-a372-7202194619a2 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:55.853895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6885335-3054-4308-a372-7202194619a2 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:55.854428 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6885335-3054-4308-a372-7202194619a2 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:55.855532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6885335-3054-4308-a372-7202194619a2 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:55.856161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6885335-3054-4308-a372-7202194619a2 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:55.885929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b6885335-3054-4308-a372-7202194619a2 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Jul 19 13:08:55.886492 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1064/1986] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 13:08:55 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:08:56.632475 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-58450795-b9f0-44c6-a255-5aac87ae3e10 req-c1d80756-11a1-4993-819d-9788ee2b6149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afef3a18-c621-48c5-b792-b0bab25edf6c", "tag": "362de188-c5db-46ee-a3d3-bcb4d6f1392b"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:56.641398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-58450795-b9f0-44c6-a255-5aac87ae3e10 req-c1d80756-11a1-4993-819d-9788ee2b6149 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:56.642541 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-58450795-b9f0-44c6-a255-5aac87ae3e10 req-c1d80756-11a1-4993-819d-9788ee2b6149 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:56.654020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-58450795-b9f0-44c6-a255-5aac87ae3e10 req-c1d80756-11a1-4993-819d-9788ee2b6149 service nova] Creating event network-changed:362de188-c5db-46ee-a3d3-bcb4d6f1392b for instance afef3a18-c621-48c5-b792-b0bab25edf6c on hv-cinder-82099 Jul 19 13:08:56.658949 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-58450795-b9f0-44c6-a255-5aac87ae3e10 req-c1d80756-11a1-4993-819d-9788ee2b6149 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030709 Jul 19 13:08:56.659543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 923/1987] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:08:56.862118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:56.862606 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:56.868980 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:56.869426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:56.870196 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:56.870624 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:56.899333 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-aed4b175-aa5a-433f-81ee-c3251d07f34f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:56.900372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-aed4b175-aa5a-433f-81ee-c3251d07f34f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:56.907313 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed4b175-aa5a-433f-81ee-c3251d07f34f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:56.907764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed4b175-aa5a-433f-81ee-c3251d07f34f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:56.908562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed4b175-aa5a-433f-81ee-c3251d07f34f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:56.908998 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aed4b175-aa5a-433f-81ee-c3251d07f34f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:56.939230 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-aed4b175-aa5a-433f-81ee-c3251d07f34f tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044286 Jul 19 13:08:56.940105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 924/1988] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 13:08:56 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 13:08:56.950155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:56.950647 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:56.957134 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:56.957583 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lazy-loading 'services' on Instance uuid 529d0843-a3f3-4095-8586-1049ce771a18 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:08:56.957751 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:56.958346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:56.958783 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:57.034099 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] HTTP exception thrown: Instance afef3a18-c621-48c5-b792-b0bab25edf6c is not attached to volume 960d6e53-cf7a-4ae4-b14e-c50a9612eee4 Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Request method failure captured: Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments/960d6e53-cf7a-4ae4-b14e-c50a9612eee4 HTTP/1.1 Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qxnUurFUHMdHj6T6ps5JpWk9qhGxII3wuh0T-asAnElH9Y2OF-DiZ76MDqcqjcRckMwHr9uCjQ-bsENlSDf3oEWrWOGaxTrYG7_cGStHxt8Dn3BuggA4eVcZ71Q1dbDLe4Df5mzpShTVae8hSyJH_7yLhFLSwAvIfo5DHVUXw8e2sQ Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 655b99de30324b49b9d33a3f3f4051a8 Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-TestMinimumBasicScenario-1984753792 Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:08:57.036487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/655b99de30324b49b9d33a3f3f4051a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_655b99de30324b49b9d33a3f3f4051a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/655b99de30324b49b9d33a3f3f4051a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/655b99de30324b49b9d33a3f3f4051a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-TestMinimumBasicScenario-1984753792 Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 655b99de30324b49b9d33a3f3f4051a8 Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1984753792 Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-TestMinimumBasicScenario-1984753792-project Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 03318d8ab40e4aa5b0db0e893c79ec61 Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-TestMinimumBasicScenario-1984753792-project Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:08:57.038349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance afef3a18-c621-48c5-b792-b0bab25edf6c is not attached to volume 960d6e53-cf7a-4ae4-b14e-c50a9612eee4 Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'server_id': 'afef3a18-c621-48c5-b792-b0bab25edf6c', 'id': '960d6e53-cf7a-4ae4-b14e-c50a9612eee4'} Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 960d6e53-cf7a-4ae4-b14e-c50a9612eee4. Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:08:57.039347 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afef3a18-c621-48c5-b792-b0bab25edf6c is not attached to volume 960d6e53-cf7a-4ae4-b14e-c50a9612eee4 Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afef3a18-c621-48c5-b792-b0bab25edf6c is not attached to volume 960d6e53-cf7a-4ae4-b14e-c50a9612eee4 Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:08:57.041888 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Returning 404 to user: Instance afef3a18-c621-48c5-b792-b0bab25edf6c is not attached to volume 960d6e53-cf7a-4ae4-b14e-c50a9612eee4 {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:08:57.043909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2670028e-a369-45b7-b713-1b997cb63fb4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments/960d6e53-cf7a-4ae4-b14e-c50a9612eee4" status: 404 len: 154 microversion: 2.1 time: 0.091977 Jul 19 13:08:57.043909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 925/1989] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 13:08:56 2022] DELETE /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c/os-volume_attachments/960d6e53-cf7a-4ae4-b14e-c50a9612eee4 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:08:57.044442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1a8976c2-55f9-4d63-9a53-a1ef7408d394 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-volume_attachments/39232105-ae3e-4901-9571-da12b6fd5d45" status: 202 len: 0 microversion: 2.1 time: 0.185233 Jul 19 13:08:57.044442 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1065/1990] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 13:08:56 2022] DELETE /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-volume_attachments/39232105-ae3e-4901-9571-da12b6fd5d45 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:08:58.158874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dff0fbab-7733-48d3-8a6c-3cafc04fdb72 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:08:58.165253 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dff0fbab-7733-48d3-8a6c-3cafc04fdb72 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:58.165703 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dff0fbab-7733-48d3-8a6c-3cafc04fdb72 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:58.188443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dff0fbab-7733-48d3-8a6c-3cafc04fdb72 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Going to try to stop instance {{(pid=118119) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 13:08:58.212927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:58.212927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:58.212927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:58.212927 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:58.214056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:58.214056 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:58.238701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:08:58.240136 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dff0fbab-7733-48d3-8a6c-3cafc04fdb72 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action" status: 202 len: 0 microversion: 2.1 time: 0.084854 Jul 19 13:08:58.240829 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 926/1991] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:08:58 2022] POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:08:58.249048 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:58.249756 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:58.257319 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:58.257779 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:58.258554 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:58.258997 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:58.328204 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9f469170-f589-45f7-9919-865e7b5116fa tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 204 len: 0 microversion: 2.1 time: 0.132713 Jul 19 13:08:58.333024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1066/1992] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:08:58 2022] DELETE /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 13:08:58.343485 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:58.344280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:58.350608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:58.351071 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:58.351849 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:58.352321 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:58.411941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:58.419686 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-fd6cc864-2850-4673-ade0-c3fb7c4146af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.174653 Jul 19 13:08:58.420275 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 927/1993] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:58 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:08:58.494665 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:58.502663 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a41fc73b-0415-4875-b9d2-2a404d9b81bf tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1554 microversion: 2.1 time: 0.167932 Jul 19 13:08:58.503220 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1067/1994] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:58 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:08:59.438912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:59.439522 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:59.445969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:59.446427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:59.447200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:59.447643 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:59.519127 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:08:59.519763 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:08:59.526111 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:59.526557 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:59.527318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:08:59.527751 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:08:59.604117 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:59.614252 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d3f093cd-198b-4a6c-8688-d5606bd96577 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.180258 Jul 19 13:08:59.614831 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 928/1995] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:59 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:08:59.668098 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:08:59.675581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-15370ee9-4185-4d1e-9057-9f14efb18f25 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1554 microversion: 2.1 time: 0.160557 Jul 19 13:08:59.676202 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1068/1996] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:08:59 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:00.597725 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-b9c5ef7b-13d7-4861-a1be-0a834aa105ad req-07e2e682-08a2-478e-8996-cd412f778512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afef3a18-c621-48c5-b792-b0bab25edf6c", "name": "network-vif-deleted", "tag": "362de188-c5db-46ee-a3d3-bcb4d6f1392b"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:00.608823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-b9c5ef7b-13d7-4861-a1be-0a834aa105ad req-07e2e682-08a2-478e-8996-cd412f778512 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:00.608823 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-b9c5ef7b-13d7-4861-a1be-0a834aa105ad req-07e2e682-08a2-478e-8996-cd412f778512 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:00.621221 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-b9c5ef7b-13d7-4861-a1be-0a834aa105ad req-07e2e682-08a2-478e-8996-cd412f778512 service nova] Creating event network-vif-deleted:362de188-c5db-46ee-a3d3-bcb4d6f1392b for instance afef3a18-c621-48c5-b792-b0bab25edf6c on hv-cinder-82099 Jul 19 13:09:00.627785 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-b9c5ef7b-13d7-4861-a1be-0a834aa105ad req-07e2e682-08a2-478e-8996-cd412f778512 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093676 Jul 19 13:09:00.628608 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 929/1997] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:09:00.633210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:00.633872 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:00.640689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:00.641139 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:00.641897 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:00.642328 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:00.693050 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:00.693759 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:00.700259 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:00.700663 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:00.701436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:00.701874 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:00.731826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:00.732309 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:00.732768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lazy-loading 'fault' on Instance uuid afef3a18-c621-48c5-b792-b0bab25edf6c {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:09:00.788448 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03318d8ab40e4aa5b0db0e893c79ec61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655b99de30324b49b9d33a3f3f4051a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:00.796194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b8c01e1a-e429-4b17-8878-2df425abf9f4 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 200 len: 1348 microversion: 2.1 time: 0.107355 Jul 19 13:09:00.797618 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 930/1998] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:00 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:00.804585 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:00.812260 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a7d7404-e8fb-4d3f-845f-c4e95ee8d6d9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.182683 Jul 19 13:09:00.819742 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1069/1999] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:00 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:01.814758 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:01.815377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] [instance: afef3a18-c621-48c5-b792-b0bab25edf6c] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:01.821819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:01.822267 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:01.823034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:01.823551 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:01.829047 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:01.829682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:01.836289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:01.836749 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:01.837390 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] HTTP exception thrown: Instance afef3a18-c621-48c5-b792-b0bab25edf6c could not be found. Jul 19 13:09:01.837549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:01.837960 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Request method failure captured: Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c HTTP/1.1 Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qxnUurFUHMdHj6T6ps5JpWk9qhGxII3wuh0T-asAnElH9Y2OF-DiZ76MDqcqjcRckMwHr9uCjQ-bsENlSDf3oEWrWOGaxTrYG7_cGStHxt8Dn3BuggA4eVcZ71Q1dbDLe4Df5mzpShTVae8hSyJH_7yLhFLSwAvIfo5DHVUXw8e2sQ Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 655b99de30324b49b9d33a3f3f4051a8 Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-TestMinimumBasicScenario-1984753792 Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:09:01.839018 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/655b99de30324b49b9d33a3f3f4051a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_655b99de30324b49b9d33a3f3f4051a8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/655b99de30324b49b9d33a3f3f4051a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/655b99de30324b49b9d33a3f3f4051a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-TestMinimumBasicScenario-1984753792 Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 655b99de30324b49b9d33a3f3f4051a8 Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1984753792 Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-TestMinimumBasicScenario-1984753792-project Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 03318d8ab40e4aa5b0db0e893c79ec61 Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-TestMinimumBasicScenario-1984753792-project Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance afef3a18-c621-48c5-b792-b0bab25edf6c could not be found. Jul 19 13:09:01.839940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'afef3a18-c621-48c5-b792-b0bab25edf6c'} Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afef3a18-c621-48c5-b792-b0bab25edf6c could not be found. Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:09:01.840531 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afef3a18-c621-48c5-b792-b0bab25edf6c could not be found. Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afef3a18-c621-48c5-b792-b0bab25edf6c could not be found. Jul 19 13:09:01.841372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:09:01.842145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Returning 404 to user: Instance afef3a18-c621-48c5-b792-b0bab25edf6c could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:09:01.842145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-eff0f405-0c0b-4e8a-a07c-a63a87cecc90 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c" status: 404 len: 111 microversion: 2.1 time: 0.029999 Jul 19 13:09:01.842145 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 931/2000] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:01 2022] GET /compute/v2.1/servers/afef3a18-c621-48c5-b792-b0bab25edf6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:09:01.849023 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-beaaf136-21fe-4720-b79f-b2ba0ffb9433 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] Calling method '.version_select at 0x7fd994399040>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:01.868237 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-beaaf136-21fe-4720-b79f-b2ba0ffb9433 tempest-TestMinimumBasicScenario-1984753792 tempest-TestMinimumBasicScenario-1984753792-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2145895264" status: 202 len: 0 microversion: 2.1 time: 0.022656 Jul 19 13:09:01.868804 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 932/2001] 10.222.0.13 () {58 vars in 1271 bytes} [Tue Jul 19 13:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2145895264 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 13:09:01.977847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:01.986287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f0308f2-77b4-44e1-920e-39dc5985b6bd tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.161305 Jul 19 13:09:01.986788 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1070/2002] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:01 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:03.004124 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:03.004765 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:03.011486 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:03.012008 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:03.012850 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:03.013294 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:03.155789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:03.163946 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-e4062dda-b3f1-46f4-8bd4-7af3e155f788 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.164707 Jul 19 13:09:03.164548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 933/2003] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:02 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:04.181452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:04.182343 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:04.188860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:04.189318 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:04.190082 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:04.190671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:04.342266 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:04.352929 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7e1b49d-1a52-4041-80d1-43fb8c8dd9ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.174896 Jul 19 13:09:04.353618 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1071/2004] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:04 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:05.371372 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:05.371834 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:05.378952 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:05.379636 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:05.380665 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:05.381308 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:05.567104 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:05.575174 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2602bc0e-9815-4d8e-b1be-f7fcc49d0f47 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.209055 Jul 19 13:09:05.575908 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 934/2005] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:05 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:06.592601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:06.593144 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:06.599533 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:06.599993 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:06.600835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:06.601312 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:06.839035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:06.847207 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b3428a8d-d20f-49d8-be48-6e195f1bbd57 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.258797 Jul 19 13:09:06.848103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1072/2006] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:06 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:07.865480 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:07.866088 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:07.872455 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:07.873865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:07.873865 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:07.874103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:08.081114 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:08.089160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-da2bda26-9b94-4093-a390-a514479c64ae tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1678 microversion: 2.1 time: 0.227857 Jul 19 13:09:08.089923 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 935/2007] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:07 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:09.106094 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:09.107004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:09.113214 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:09.113653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:09.114411 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:09.114841 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:09.250037 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:09.257517 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41659b51-07ff-4e0e-8acc-0a7ad100be2b tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1655 microversion: 2.1 time: 0.155637 Jul 19 13:09:09.258093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1073/2008] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:09 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:09.274713 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-a17ba86c-85a1-44be-8ed1-229bc28b38ff tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:09.281358 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a17ba86c-85a1-44be-8ed1-229bc28b38ff tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:09.281909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-a17ba86c-85a1-44be-8ed1-229bc28b38ff tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:09.305726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-a17ba86c-85a1-44be-8ed1-229bc28b38ff tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Going to try to start instance {{(pid=118119) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 13:09:09.348796 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-a17ba86c-85a1-44be-8ed1-229bc28b38ff tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action" status: 202 len: 0 microversion: 2.1 time: 0.077802 Jul 19 13:09:09.349392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 936/2009] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:09:09 2022] POST /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:09:09.358039 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:09.358655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:09.365529 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:09.366011 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:09.367122 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:09.367576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:09.545161 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:09.554578 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32c837c2-d68c-458c-b1ba-0a97cd70ffea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1664 microversion: 2.1 time: 0.200567 Jul 19 13:09:09.556223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1074/2010] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:09 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1664 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:10.573176 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:10.574432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:10.581241 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:10.581695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:10.582469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:10.582917 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:10.717200 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:10.721496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:10.726330 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-63051f64-29e9-4c11-9b51-55aba9b69174 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1664 microversion: 2.1 time: 0.157799 Jul 19 13:09:10.726913 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 937/2011] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:10 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:11.743157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:11.743768 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:11.750638 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:11.751248 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:11.752157 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:11.752748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:11.898979 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:11.907981 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9ad97d8a-2ff2-4136-89fb-90f53a7dd781 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1668 microversion: 2.1 time: 0.168620 Jul 19 13:09:11.908858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1075/2012] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:11 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:20.138918 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-3314216b-e193-4ba4-b19f-d23c8206f059 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Action: 'create', calling method: .version_select at 0x7fd99466ee50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1779728470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH18AVPGtCecQmmmdbWlEYlGdzliyc5KcENhxGcyK6MDnF7mQYuQnIJsg7n0O0GZZxeriAGq1gOPhJQEkRNrz1gYJZvyWMjTQDtIJPdXJ74VHXZDgf+p8f/RNdX5i245wQ=="}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:20.154433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-3314216b-e193-4ba4-b19f-d23c8206f059 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Getting quotas for project 3de65ab2754b49d69c41eb4d2870648e. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:09:20.158281 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-3314216b-e193-4ba4-b19f-d23c8206f059 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Getting quotas for user 97565560b942439c9c4c09bf3097b8c8 and project 3de65ab2754b49d69c41eb4d2870648e. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:09:20.180392 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-3314216b-e193-4ba4-b19f-d23c8206f059 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.214255 Jul 19 13:09:20.180995 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 938/2013] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 13:09:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:09:34.297512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:09:34.298033 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:09:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:09:35.357382 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-924472461", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1779728470", "security_groups": [{"name": "tempest-secgroup-smoke-191817592"}], "networks": [{"uuid": "13131525-3184-4dd4-af18-1269af4f6125"}], "block_device_mapping_v2": [{"uuid": "2322b5f1-fc10-4489-92de-519429693923", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:35.366137 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:35.366786 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:35.471649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] validate_networks() for [('13131525-3184-4dd4-af18-1269af4f6125', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 13:09:35.936969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 13:09:35.938049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 13:09:35.938548 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 13:09:35.938975 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 13:09:35.939378 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 13:09:35.948021 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:35.948615 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:35.949414 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:35.949855 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:35.966539 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Getting quotas for project 3de65ab2754b49d69c41eb4d2870648e. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:09:35.970986 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Getting quotas for user 97565560b942439c9c4c09bf3097b8c8 and project 3de65ab2754b49d69c41eb4d2870648e. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:09:36.025728 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 13:09:36.027779 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2322b5f1-fc10-4489-92de-519429693923',volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 13:09:36.151857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3903ca09-42c9-4675-8eda-4d27cffc171b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.798345 Jul 19 13:09:36.152534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1076/2014] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 13:09:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 13:09:36.160491 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:36.161643 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:36.165983 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2f5e0153-a90e-46d1-a742-7fdf5c4bedcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:36.166637 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2f5e0153-a90e-46d1-a742-7fdf5c4bedcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:36.223592 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2f5e0153-a90e-46d1-a742-7fdf5c4bedcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:36.230912 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2f5e0153-a90e-46d1-a742-7fdf5c4bedcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1088 microversion: 2.1 time: 0.071724 Jul 19 13:09:36.231468 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 939/2015] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:36 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:36.381445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 19 13:09:36.381645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:09:37.251126 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:37.251740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:37.257954 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:37.258409 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:37.259179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:37.259614 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:37.329133 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:37.339343 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a9d673d-9074-4ab0-a72c-91d1b7447c49 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1204 microversion: 2.1 time: 0.093969 Jul 19 13:09:37.348969 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1077/2016] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:37 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:38.356305 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:38.356924 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:38.363440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:38.363895 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:38.364693 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:38.365129 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:38.505885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:38.513987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-26855fe3-aafd-4cd8-9caa-9e82a34278d6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.161483 Jul 19 13:09:38.514772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 940/2017] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:38 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:38.586198 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-36280525-cd40-41b7-aefc-30d0a746ede0 req-c066f1cb-96bc-4648-a6e4-7fe1e4438bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624e91cb-5f7c-4803-b0f8-763a0ff208df", "tag": "6b6adb28-9a6c-48ce-80b9-619e1d832e83"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:38.603527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-36280525-cd40-41b7-aefc-30d0a746ede0 req-c066f1cb-96bc-4648-a6e4-7fe1e4438bf6 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:38.607009 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-36280525-cd40-41b7-aefc-30d0a746ede0 req-c066f1cb-96bc-4648-a6e4-7fe1e4438bf6 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:38.622446 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-36280525-cd40-41b7-aefc-30d0a746ede0 req-c066f1cb-96bc-4648-a6e4-7fe1e4438bf6 service nova] Creating event network-changed:6b6adb28-9a6c-48ce-80b9-619e1d832e83 for instance 624e91cb-5f7c-4803-b0f8-763a0ff208df on hv-cinder-82099 Jul 19 13:09:38.628462 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-36280525-cd40-41b7-aefc-30d0a746ede0 req-c066f1cb-96bc-4648-a6e4-7fe1e4438bf6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045998 Jul 19 13:09:38.628997 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1078/2018] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:09:39.532297 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:39.532893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:39.539126 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:39.539573 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:39.540394 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:39.540828 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:39.675658 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:39.683333 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-f3823814-ea96-490c-aec0-a22abc1cf884 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.155651 Jul 19 13:09:39.683907 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 941/2019] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:39 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:40.701062 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:40.701756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:40.708103 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:40.708601 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:40.709371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:40.709811 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:40.845647 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:40.853354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5b1e91c9-0b1e-4855-8257-6becb5ffae7b tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.156951 Jul 19 13:09:40.853921 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1079/2020] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:40 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:41.870261 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:41.870909 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:41.877890 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:41.878340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:41.879101 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:41.879535 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:42.018816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:42.026497 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c4a9de73-cc63-4054-8937-e6af1a5f2e64 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.160099 Jul 19 13:09:42.027077 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 942/2021] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:41 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:43.043713 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:43.044374 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:43.050738 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:43.051184 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:43.051936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:43.052402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:43.182708 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:43.190675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb1b8279-31ef-4324-8342-968769c4d83f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.150805 Jul 19 13:09:43.191238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1080/2022] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:43 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:44.207203 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:44.207844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:44.214290 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:44.214742 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:44.215501 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:44.215942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:44.347412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:44.354864 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-501a367b-aee7-46f5-a961-035f28dd5681 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.152034 Jul 19 13:09:44.355429 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 943/2023] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:44 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:45.208465 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4df91d3e-abea-4013-aa73-defb020c93f7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:45.209448 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4df91d3e-abea-4013-aa73-defb020c93f7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:45.216201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df91d3e-abea-4013-aa73-defb020c93f7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.216675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df91d3e-abea-4013-aa73-defb020c93f7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.217444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df91d3e-abea-4013-aa73-defb020c93f7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.217879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4df91d3e-abea-4013-aa73-defb020c93f7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.246767 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4df91d3e-abea-4013-aa73-defb020c93f7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042306 Jul 19 13:09:45.247322 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1081/2024] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 13:09:45 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 13:09:45.304799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:45.305320 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:45.312123 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.312755 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.313772 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.314316 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.344240 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Going to try to terminate instance {{(pid=118119) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:09:45.370923 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:45.371750 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:45.378402 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.378858 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.379806 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.380156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.433127 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-062a6ca1-f988-49a7-8ffd-6a91e67bfeaa tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 204 len: 0 microversion: 2.1 time: 0.131716 Jul 19 13:09:45.436684 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 944/2025] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:09:45 2022] DELETE /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 13:09:45.443547 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:45.444321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:45.452458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.453346 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.453695 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:45.454664 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:45.562030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:45.569673 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f003ad3b-d58f-48b4-b1ba-8a05404e1321 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.202493 Jul 19 13:09:45.570287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1082/2026] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:45 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:45.608039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:45.615576 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-09f49955-d045-4d68-9ded-ceb44ffac17a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1674 microversion: 2.1 time: 0.177307 Jul 19 13:09:45.616150 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 945/2027] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:45 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:46.587177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:46.587748 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:46.589704 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:46.590354 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:46.597346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:46.598040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:46.598541 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:46.599080 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:46.632405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:46.633016 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:46.635235 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:09:46.642166 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:46.642746 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:46.643786 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:46.644243 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:46.781600 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:46.789574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2fe89e45-09d4-4ecc-94c0-1d973cf1750d tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.206280 Jul 19 13:09:46.790154 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1083/2028] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:46 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:46.810971 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:46.818440 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-da337894-58d0-4194-b119-dff9008d06ab tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1674 microversion: 2.1 time: 0.189864 Jul 19 13:09:46.819020 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 946/2029] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:46 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:47.806818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:47.808440 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:47.816004 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:47.816557 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:47.817537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:47.818168 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:47.834897 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:47.836202 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:47.842885 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:47.843771 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:47.844833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:47.845472 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:48.034076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:48.041750 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b6033a5c-40b3-4253-ade0-ce886bce4d09 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.238687 Jul 19 13:09:48.042732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1084/2030] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:47 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:48.045184 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:48.053350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-97eb2efb-4719-498e-9b9c-ee809a70d286 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 200 len: 1674 microversion: 2.1 time: 0.222304 Jul 19 13:09:48.053914 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 947/2031] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:47 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:48.369844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-2831961a-2d07-4030-9bea-3a99fbc7e9b5 req-a292b06c-ca78-4ba1-ad6e-a22c83d80427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529d0843-a3f3-4095-8586-1049ce771a18", "name": "network-vif-deleted", "tag": "e765ed30-cfc3-4758-86c6-68352e89fcc0"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:48.378097 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-2831961a-2d07-4030-9bea-3a99fbc7e9b5 req-a292b06c-ca78-4ba1-ad6e-a22c83d80427 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:48.378546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-2831961a-2d07-4030-9bea-3a99fbc7e9b5 req-a292b06c-ca78-4ba1-ad6e-a22c83d80427 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:48.389847 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-2831961a-2d07-4030-9bea-3a99fbc7e9b5 req-a292b06c-ca78-4ba1-ad6e-a22c83d80427 service nova] Creating event network-vif-deleted:e765ed30-cfc3-4758-86c6-68352e89fcc0 for instance 529d0843-a3f3-4095-8586-1049ce771a18 on hv-cinder-82099 Jul 19 13:09:48.395658 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-2831961a-2d07-4030-9bea-3a99fbc7e9b5 req-a292b06c-ca78-4ba1-ad6e-a22c83d80427 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029853 Jul 19 13:09:48.396489 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1085/2032] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:09:49.058906 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:49.059641 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:49.067496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:49.068056 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:49.069015 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:49.069462 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:49.072138 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:49.072995 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:49.079344 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:49.079798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:49.080603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:49.081043 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:49.094115 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] HTTP exception thrown: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Request method failure captured: Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 HTTP/1.1 Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qx4CcuHWw1Ld6PYJRQUbE4_vcvMJuEqsqU8EmOvHDjjQLAF6ZxI37tp_y7Z_uBPhBTMUG3HA1HqPf-NCKlZgGEGo6j_M_Hnpu23gbAibfxE1xbz8Yo9Bzd4vOaWn6wVZcUdRDdSRcesweYPpQ5GDUXnz2d9_p7bFZusUIIpIluauk0 Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:09:49.095789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_491e79a36d5b4f8cb3952be89ae6c03d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 70ba1847a4044ae6a338cdb4c80af5df Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:09:49.097142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '529d0843-a3f3-4095-8586-1049ce771a18'} Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:09:49.097941 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:09:49.099153 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:09:49.100438 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Returning 404 to user: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:09:49.100438 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de45c18b-6be2-4174-88f0-0ffe8fd0224a tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 404 len: 111 microversion: 2.1 time: 0.030452 Jul 19 13:09:49.100438 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1086/2033] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:49 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 13:09:49.105966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7452fb87-a1d3-4876-bb50-742422500d23 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '.version_select at 0x7fd9944718b0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:49.128366 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7452fb87-a1d3-4876-bb50-742422500d23 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508292674" status: 202 len: 0 microversion: 2.1 time: 0.026083 Jul 19 13:09:49.132567 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1087/2034] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jul 19 13:09:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508292674 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 13:09:49.216350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:49.224118 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-df3e8955-58bc-438e-89e0-59fb3303ff94 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.168971 Jul 19 13:09:49.224741 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 948/2035] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:49 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:49.596545 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-c33f0fbf-bbac-4912-b0e0-041da1d2512d req-22592009-cd48-482b-9ef4-16e526c83292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624e91cb-5f7c-4803-b0f8-763a0ff208df", "name": "network-vif-plugged", "status": "completed", "tag": "6b6adb28-9a6c-48ce-80b9-619e1d832e83"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:49.608394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-c33f0fbf-bbac-4912-b0e0-041da1d2512d req-22592009-cd48-482b-9ef4-16e526c83292 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:49.608394 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-c33f0fbf-bbac-4912-b0e0-041da1d2512d req-22592009-cd48-482b-9ef4-16e526c83292 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:49.627294 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-c33f0fbf-bbac-4912-b0e0-041da1d2512d req-22592009-cd48-482b-9ef4-16e526c83292 service nova] Creating event network-vif-plugged:6b6adb28-9a6c-48ce-80b9-619e1d832e83 for instance 624e91cb-5f7c-4803-b0f8-763a0ff208df on hv-cinder-82099 Jul 19 13:09:49.632346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-c33f0fbf-bbac-4912-b0e0-041da1d2512d req-22592009-cd48-482b-9ef4-16e526c83292 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102222 Jul 19 13:09:49.633515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1088/2036] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 13:09:49.816661 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-6a2f1614-5a84-4b8c-bca6-86f9f63133f9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'create', calling method: .version_select at 0x7fd998178790>, body: {"keypair": {"name": "tempest-keypair-1813113157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFDLwGmCmFGHHJm21oZH9zb957LmBCfUEsIIG54+NAkDRIjiFwbLKteBuv/JF+wW0x9V0uI8vHb5CI/2On1pqzR0ZdFzjyF3gdTc6alBRktWlYuEsATOzaROOgmjVB9Yw=="}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:49.831999 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-6a2f1614-5a84-4b8c-bca6-86f9f63133f9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:09:49.836264 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-6a2f1614-5a84-4b8c-bca6-86f9f63133f9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for user 70ba1847a4044ae6a338cdb4c80af5df and project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'key_pairs'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:09:49.859504 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-6a2f1614-5a84-4b8c-bca6-86f9f63133f9 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046857 Jul 19 13:09:49.865702 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 949/2037] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jul 19 13:09:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:09:50.243346 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:50.244146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:50.254537 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:50.255694 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:50.256617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:50.257174 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:50.392844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:50.407496 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9ab2488f-6e2d-42fe-92ab-e83ecb79db0e tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1259 microversion: 2.1 time: 0.168918 Jul 19 13:09:50.408079 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1089/2038] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:50 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:51.178586 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-292173340", "imageRef": "6cef6f36-b332-43d0-97dd-f4a799ea5aa8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b633f5b-e2eb-45b3-a5b0-525989012ba9"}], "security_groups": [{"name": "tempest-securitygroup--812488571"}], "key_name": "tempest-keypair-1813113157", "user_data": "}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:51.277557 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.network.neutron [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] validate_networks() for [('9b633f5b-e2eb-45b3-a5b0-525989012ba9', None, None, None, None, None)] {{(pid=118119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 13:09:51.423813 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:51.424368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:51.430686 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:51.431135 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:51.431885 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:51.432350 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:51.633812 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:51.642368 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d98bc64-54c6-4e74-814b-c68fc6835e31 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1443 microversion: 2.1 time: 0.222416 Jul 19 13:09:51.642934 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1090/2039] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:51 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1443 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:51.659031 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:51.659789 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:51.665576 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:51.666023 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:51.666791 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:51.667223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:51.748727 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Flavor limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 13:09:51.749156 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Image limits 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 13:09:51.749639 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Flavor pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 13:09:51.750054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Image pref 0:0:0 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 13:09:51.750960 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.virt.hardware [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 13:09:51.759739 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:51.760349 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:51.761155 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:51.761596 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:51.778994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 13:09:51.783086 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.quota [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Getting quotas for user 70ba1847a4044ae6a338cdb4c80af5df and project 491e79a36d5b4f8cb3952be89ae6c03d. Resources: {'cores', 'instances', 'ram'} {{(pid=118119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 13:09:51.794218 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Going to run 1 instances... {{(pid=118119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 13:09:51.796515 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cef6f36-b332-43d0-97dd-f4a799ea5aa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 13:09:51.812205 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:51.823114 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8bac33f5-8e7e-49a8-ba44-4195c689d237 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1443 microversion: 2.1 time: 0.168106 Jul 19 13:09:51.824055 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1091/2040] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:51 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:51.849535 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ddd0b7c5-fce1-4764-b8a1-548937bb32af tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676748 Jul 19 13:09:51.850513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 950/2041] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jul 19 13:09:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 13:09:51.861834 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a7d9d362-4007-4867-96fe-415b743e4ae6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:51.862452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a7d9d362-4007-4867-96fe-415b743e4ae6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:51.920636 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7d9d362-4007-4867-96fe-415b743e4ae6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:51.927903 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a7d9d362-4007-4867-96fe-415b743e4ae6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1237 microversion: 2.1 time: 0.071060 Jul 19 13:09:51.939274 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1092/2042] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:51 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:52.945598 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:52.946242 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:52.952286 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:52.952744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:52.953989 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:52.954433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:53.014775 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:53.022941 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-dd18cdcd-46d9-4549-b9ef-086fb41e775f tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1295 microversion: 2.1 time: 0.081632 Jul 19 13:09:53.023506 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 951/2043] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:52 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:54.039736 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:54.040379 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:54.046818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:54.047871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:54.048671 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:54.049105 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:54.118815 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:54.129255 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6252ac90-059a-427e-803b-5653fb129e25 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1295 microversion: 2.1 time: 0.093410 Jul 19 13:09:54.131093 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1093/2044] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:54 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:54.259876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-c1b3fc79-90ce-4b07-a144-2b33cf35b160 req-04cad7b4-dfd0-4c53-826f-7fafe9ee100b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624e91cb-5f7c-4803-b0f8-763a0ff208df", "tag": "6b6adb28-9a6c-48ce-80b9-619e1d832e83"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:54.274010 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-c1b3fc79-90ce-4b07-a144-2b33cf35b160 req-04cad7b4-dfd0-4c53-826f-7fafe9ee100b service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:54.274679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-c1b3fc79-90ce-4b07-a144-2b33cf35b160 req-04cad7b4-dfd0-4c53-826f-7fafe9ee100b service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:54.288939 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-c1b3fc79-90ce-4b07-a144-2b33cf35b160 req-04cad7b4-dfd0-4c53-826f-7fafe9ee100b service nova] Creating event network-changed:6b6adb28-9a6c-48ce-80b9-619e1d832e83 for instance 624e91cb-5f7c-4803-b0f8-763a0ff208df on hv-cinder-82099 Jul 19 13:09:54.296706 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-c1b3fc79-90ce-4b07-a144-2b33cf35b160 req-04cad7b4-dfd0-4c53-826f-7fafe9ee100b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043529 Jul 19 13:09:54.298466 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 952/2045] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:09:55.147905 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:55.148688 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:55.155844 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:55.156547 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:55.158131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:55.158764 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:55.314083 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:55.321973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e26afd9-4c73-4004-b215-f3c34705f001 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1362 microversion: 2.1 time: 0.178214 Jul 19 13:09:55.324227 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1094/2046] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:55 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:56.317383 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-a6e90822-c609-49fb-9ccb-3ac682b00326 req-677f0395-f908-4686-87ab-4279f80da80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f981e4bc-3359-49e5-a708-7cbcd570256b", "tag": "d8708285-f641-4742-9fb1-82e4b43a90d6"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:09:56.325410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-a6e90822-c609-49fb-9ccb-3ac682b00326 req-677f0395-f908-4686-87ab-4279f80da80b service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:56.325851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-a6e90822-c609-49fb-9ccb-3ac682b00326 req-677f0395-f908-4686-87ab-4279f80da80b service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:56.338161 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-a6e90822-c609-49fb-9ccb-3ac682b00326 req-677f0395-f908-4686-87ab-4279f80da80b service nova] Creating event network-changed:d8708285-f641-4742-9fb1-82e4b43a90d6 for instance f981e4bc-3359-49e5-a708-7cbcd570256b on hv-cinder-82099 Jul 19 13:09:56.342349 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:56.342961 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:56.347569 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-a6e90822-c609-49fb-9ccb-3ac682b00326 req-677f0395-f908-4686-87ab-4279f80da80b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035334 Jul 19 13:09:56.348859 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 953/2047] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:09:56.351223 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:56.351672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:56.352675 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:56.353113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:56.491132 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:56.498546 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c723109-a75c-4e68-82e9-28f02c6c6cea tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1362 microversion: 2.1 time: 0.162920 Jul 19 13:09:56.499108 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1095/2048] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:56 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:09:57.517527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:57.518258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:57.524700 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:57.525157 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:57.525919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:57.526362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:57.654714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:57.662819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-62f9f0d5-5ed8-4a27-ac3b-a16db120a844 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1362 microversion: 2.1 time: 0.150458 Jul 19 13:09:57.663395 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 954/2049] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:57 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:58.679549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:58.680158 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:58.687190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:58.687632 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:58.688430 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:58.688862 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:58.818355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:58.825608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7242340-7398-4b03-8c2f-a31346fa7d7d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1362 microversion: 2.1 time: 0.149851 Jul 19 13:09:58.826166 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1096/2050] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:58 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:09:59.842839 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:09:59.843567 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:09:59.850034 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:59.850492 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:59.851335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:09:59.851809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:09:59.983940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:09:59.991833 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-61869c6d-2bd5-46af-8f29-6faa5ee27ec7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1362 microversion: 2.1 time: 0.152843 Jul 19 13:09:59.992437 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 955/2051] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:09:59 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:10:01.008580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:01.009187 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:01.015608 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:01.016613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:01.017365 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:01.017798 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:01.143035 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:10:01.146758 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:01.151471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38e981fd-1a77-4842-abd1-e6adfcd71da7 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1362 microversion: 2.1 time: 0.146725 Jul 19 13:10:01.152049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1097/2052] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:10:01 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:10:01.658893 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-08bb402d-430c-4e2b-9ddc-c77735fbc20c req-9d981396-9af3-4231-893e-b61234532724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f981e4bc-3359-49e5-a708-7cbcd570256b", "name": "network-vif-plugged", "status": "completed", "tag": "d8708285-f641-4742-9fb1-82e4b43a90d6"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:10:01.669621 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-08bb402d-430c-4e2b-9ddc-c77735fbc20c req-9d981396-9af3-4231-893e-b61234532724 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:01.670068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-08bb402d-430c-4e2b-9ddc-c77735fbc20c req-9d981396-9af3-4231-893e-b61234532724 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:01.683137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-08bb402d-430c-4e2b-9ddc-c77735fbc20c req-9d981396-9af3-4231-893e-b61234532724 service nova] Creating event network-vif-plugged:d8708285-f641-4742-9fb1-82e4b43a90d6 for instance f981e4bc-3359-49e5-a708-7cbcd570256b on hv-cinder-82099 Jul 19 13:10:01.688334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-08bb402d-430c-4e2b-9ddc-c77735fbc20c req-9d981396-9af3-4231-893e-b61234532724 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033430 Jul 19 13:10:01.689111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 956/2053] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:02.167756 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:02.168345 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:02.170190 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:02.175724 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:02.176172 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:02.176970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:02.177410 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:02.305142 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:10:02.312552 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc08181e-87ba-4d70-8c50-04df671d4908 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1362 microversion: 2.1 time: 0.148751 Jul 19 13:10:02.313743 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1098/2054] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:10:02 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:10:03.327257 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=2 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:03.328072 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell0:SELECT=10 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:03.333060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:03.333762 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:03.340944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:03.341405 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:03.342321 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:03.342807 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:03.473646 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:10:03.481420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9f376a2a-90b1-4a45-8a4b-d12f4a3465ec tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1548 microversion: 2.1 time: 0.155193 Jul 19 13:10:03.481988 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 957/2055] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:10:03 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:10:03.497200 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2b79216f-bf93-48e6-89d1-943dc9a342c3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:03.497672 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2b79216f-bf93-48e6-89d1-943dc9a342c3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:03.503990 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b79216f-bf93-48e6-89d1-943dc9a342c3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:03.504471 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b79216f-bf93-48e6-89d1-943dc9a342c3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:03.505224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b79216f-bf93-48e6-89d1-943dc9a342c3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:03.505657 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b79216f-bf93-48e6-89d1-943dc9a342c3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:03.584706 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2b79216f-bf93-48e6-89d1-943dc9a342c3 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091215 Jul 19 13:10:03.585300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1099/2056] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jul 19 13:10:03 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 13:10:04.486712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-d00b1540-372c-4fbd-ad83-b114136ea850 req-30f45a52-a8ca-4c5d-b92c-f9759489c09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f981e4bc-3359-49e5-a708-7cbcd570256b", "tag": "d8708285-f641-4742-9fb1-82e4b43a90d6"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:10:04.495211 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-d00b1540-372c-4fbd-ad83-b114136ea850 req-30f45a52-a8ca-4c5d-b92c-f9759489c09d service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:04.495666 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-d00b1540-372c-4fbd-ad83-b114136ea850 req-30f45a52-a8ca-4c5d-b92c-f9759489c09d service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:04.508130 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-d00b1540-372c-4fbd-ad83-b114136ea850 req-30f45a52-a8ca-4c5d-b92c-f9759489c09d service nova] Creating event network-changed:d8708285-f641-4742-9fb1-82e4b43a90d6 for instance f981e4bc-3359-49e5-a708-7cbcd570256b on hv-cinder-82099 Jul 19 13:10:04.513171 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-d00b1540-372c-4fbd-ad83-b114136ea850 req-30f45a52-a8ca-4c5d-b92c-f9759489c09d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030742 Jul 19 13:10:04.513768 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 958/2057] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:40.341488 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:40.342247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=10 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:40.346392 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-48d13266-6c16-4f2a-b63b-5cf6a5a04639 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:40.346913 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-48d13266-6c16-4f2a-b63b-5cf6a5a04639 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:40.354617 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48d13266-6c16-4f2a-b63b-5cf6a5a04639 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:40.355075 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48d13266-6c16-4f2a-b63b-5cf6a5a04639 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:40.355879 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48d13266-6c16-4f2a-b63b-5cf6a5a04639 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:40.356353 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48d13266-6c16-4f2a-b63b-5cf6a5a04639 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:40.379936 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-48d13266-6c16-4f2a-b63b-5cf6a5a04639 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/ips" status: 200 len: 146 microversion: 2.1 time: 0.039967 Jul 19 13:10:40.380527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1100/2058] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jul 19 13:10:40 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:41.696420 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:41.697273 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:10:41.703809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-ace1699f-55d3-4cf8-8277-e3a5d9061391 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7828952-e3c6-445c-9312-f894fb647c90"}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:10:41.705427 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-ace1699f-55d3-4cf8-8277-e3a5d9061391 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:41.714640 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace1699f-55d3-4cf8-8277-e3a5d9061391 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:41.715105 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace1699f-55d3-4cf8-8277-e3a5d9061391 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:41.715911 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace1699f-55d3-4cf8-8277-e3a5d9061391 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:41.716391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-ace1699f-55d3-4cf8-8277-e3a5d9061391 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:41.978194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-ace1699f-55d3-4cf8-8277-e3a5d9061391 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283391 Jul 19 13:10:41.978819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 959/2059] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 13:10:41 2022] POST /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:48.406831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42d50256-6ca0-49c1-bbca-5db98be87259 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:48.407740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-42d50256-6ca0-49c1-bbca-5db98be87259 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:48.414746 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42d50256-6ca0-49c1-bbca-5db98be87259 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:48.415191 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42d50256-6ca0-49c1-bbca-5db98be87259 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:48.415940 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42d50256-6ca0-49c1-bbca-5db98be87259 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:48.416407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42d50256-6ca0-49c1-bbca-5db98be87259 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:48.443633 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-42d50256-6ca0-49c1-bbca-5db98be87259 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 Jul 19 13:10:48.444164 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1101/2060] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 13:10:48 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:48.454824 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-93d1d90b-8726-4543-9efa-a5188a8a39fb tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:48.455406 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-93d1d90b-8726-4543-9efa-a5188a8a39fb tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:48.462039 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93d1d90b-8726-4543-9efa-a5188a8a39fb tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:48.462487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93d1d90b-8726-4543-9efa-a5188a8a39fb tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:48.463239 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93d1d90b-8726-4543-9efa-a5188a8a39fb tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:48.463676 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-93d1d90b-8726-4543-9efa-a5188a8a39fb tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:48.492433 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-93d1d90b-8726-4543-9efa-a5188a8a39fb tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/e7828952-e3c6-445c-9312-f894fb647c90" status: 200 len: 194 microversion: 2.1 time: 0.042222 Jul 19 13:10:48.493016 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 960/2061] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Jul 19 13:10:48 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/e7828952-e3c6-445c-9312-f894fb647c90 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:49.801391 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2fe6c119-5d2a-4653-ae1f-71a2d8b59613 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f94d844-f807-4527-b984-56227c6b8e2a"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:10:49.802551 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2fe6c119-5d2a-4653-ae1f-71a2d8b59613 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:49.808873 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe6c119-5d2a-4653-ae1f-71a2d8b59613 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:49.809325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe6c119-5d2a-4653-ae1f-71a2d8b59613 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:49.810081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe6c119-5d2a-4653-ae1f-71a2d8b59613 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:49.810512 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe6c119-5d2a-4653-ae1f-71a2d8b59613 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:50.036300 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2fe6c119-5d2a-4653-ae1f-71a2d8b59613 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "POST /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238669 Jul 19 13:10:50.036902 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1102/2062] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jul 19 13:10:49 2022] POST /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 13:10:57.530513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-645ef553-a16b-4c61-86ae-74f3740924a6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:57.531487 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-645ef553-a16b-4c61-86ae-74f3740924a6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:57.538613 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-645ef553-a16b-4c61-86ae-74f3740924a6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:57.539068 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-645ef553-a16b-4c61-86ae-74f3740924a6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:57.539826 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-645ef553-a16b-4c61-86ae-74f3740924a6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:57.540300 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-645ef553-a16b-4c61-86ae-74f3740924a6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:57.568736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-645ef553-a16b-4c61-86ae-74f3740924a6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042218 Jul 19 13:10:57.569279 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 961/2063] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 13:10:57 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:57.714880 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64c86979-d7b8-4450-911a-b042656869d1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:57.715380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64c86979-d7b8-4450-911a-b042656869d1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:57.722236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64c86979-d7b8-4450-911a-b042656869d1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:57.722689 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64c86979-d7b8-4450-911a-b042656869d1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:57.723455 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64c86979-d7b8-4450-911a-b042656869d1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:57.723895 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64c86979-d7b8-4450-911a-b042656869d1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:57.751356 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64c86979-d7b8-4450-911a-b042656869d1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/e7828952-e3c6-445c-9312-f894fb647c90" status: 200 len: 194 microversion: 2.1 time: 0.040948 Jul 19 13:10:57.751947 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1103/2064] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Jul 19 13:10:57 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/e7828952-e3c6-445c-9312-f894fb647c90 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:57.761877 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:57.762476 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:57.769362 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:57.769819 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:57.770605 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:57.771045 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:57.857812 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lazy-loading 'services' on Instance uuid f981e4bc-3359-49e5-a708-7cbcd570256b {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:10:57.928111 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b60515b7-9686-4250-847c-b10b29285374 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/e7828952-e3c6-445c-9312-f894fb647c90" status: 202 len: 0 microversion: 2.1 time: 0.169958 Jul 19 13:10:57.928726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 962/2065] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 13:10:57 2022] DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/e7828952-e3c6-445c-9312-f894fb647c90 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:10:59.037534 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75238c56-e338-4441-88ab-8d54edcaefd6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:59.038040 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75238c56-e338-4441-88ab-8d54edcaefd6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:59.044398 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75238c56-e338-4441-88ab-8d54edcaefd6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:59.044850 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75238c56-e338-4441-88ab-8d54edcaefd6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:59.045598 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75238c56-e338-4441-88ab-8d54edcaefd6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:59.046029 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75238c56-e338-4441-88ab-8d54edcaefd6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:59.073355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75238c56-e338-4441-88ab-8d54edcaefd6 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/5f94d844-f807-4527-b984-56227c6b8e2a" status: 200 len: 194 microversion: 2.1 time: 0.040528 Jul 19 13:10:59.073911 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1104/2066] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Jul 19 13:10:59 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/5f94d844-f807-4527-b984-56227c6b8e2a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:10:59.085036 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:10:59.085617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:10:59.091681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:59.092119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:59.092905 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:10:59.093352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:10:59.170391 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lazy-loading 'services' on Instance uuid f981e4bc-3359-49e5-a708-7cbcd570256b {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:10:59.240530 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-9b3c0649-4382-4ddd-b38d-99350a028f0d tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/5f94d844-f807-4527-b984-56227c6b8e2a" status: 202 len: 0 microversion: 2.1 time: 0.160244 Jul 19 13:10:59.241119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 963/2067] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jul 19 13:10:59 2022] DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments/5f94d844-f807-4527-b984-56227c6b8e2a => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:11:00.393957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d55cf1cb-8267-4856-ab30-ef23118ac141 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:00.394871 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d55cf1cb-8267-4856-ab30-ef23118ac141 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:00.401957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d55cf1cb-8267-4856-ab30-ef23118ac141 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.402397 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d55cf1cb-8267-4856-ab30-ef23118ac141 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:00.403149 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d55cf1cb-8267-4856-ab30-ef23118ac141 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.403581 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d55cf1cb-8267-4856-ab30-ef23118ac141 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:00.431484 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d55cf1cb-8267-4856-ab30-ef23118ac141 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041870 Jul 19 13:11:00.432030 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1105/2068] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 13:11:00 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 13:11:00.532481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-83ae70ca-8b84-4de2-ae92-5a8d61a6d4a0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:00.533543 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-83ae70ca-8b84-4de2-ae92-5a8d61a6d4a0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:00.540854 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83ae70ca-8b84-4de2-ae92-5a8d61a6d4a0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.541314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83ae70ca-8b84-4de2-ae92-5a8d61a6d4a0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:00.542087 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83ae70ca-8b84-4de2-ae92-5a8d61a6d4a0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.542532 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-83ae70ca-8b84-4de2-ae92-5a8d61a6d4a0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:00.570309 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-83ae70ca-8b84-4de2-ae92-5a8d61a6d4a0 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042144 Jul 19 13:11:00.570792 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 964/2069] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jul 19 13:11:00 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 13:11:00.625973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:00.626468 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:00.632883 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.633334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:00.634086 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.634522 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:00.658643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:11:00.729336 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e272d168-6534-4232-b82a-0c4c0f1f1882 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 204 len: 0 microversion: 2.1 time: 0.106869 Jul 19 13:11:00.730024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1106/2070] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:11:00 2022] DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 13:11:00.738421 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:00.739038 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:00.745113 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.745572 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:00.746340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:00.746781 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:01.131171 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:01.138633 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-aa7e6d73-398a-4bcc-965a-afef9521655e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1673 microversion: 2.1 time: 0.403988 Jul 19 13:11:01.139192 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 965/2071] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:00 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1673 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:02.155635 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:02.156387 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:02.162957 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:02.163432 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:02.164247 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:02.164682 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:02.292848 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:02.300273 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7a213311-bb28-4032-bcb8-bf78714d8c41 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1673 microversion: 2.1 time: 0.148791 Jul 19 13:11:02.300829 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1107/2072] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:02 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:11:03.213607 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-e53dba76-9e2f-43f9-a8ee-3ffc429131ba req-0b78c3dd-496d-4a4e-9c4f-3236c8bdc1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f981e4bc-3359-49e5-a708-7cbcd570256b", "name": "network-vif-deleted", "tag": "d8708285-f641-4742-9fb1-82e4b43a90d6"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:11:03.222736 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-e53dba76-9e2f-43f9-a8ee-3ffc429131ba req-0b78c3dd-496d-4a4e-9c4f-3236c8bdc1e6 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:03.223199 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-e53dba76-9e2f-43f9-a8ee-3ffc429131ba req-0b78c3dd-496d-4a4e-9c4f-3236c8bdc1e6 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:03.238862 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-e53dba76-9e2f-43f9-a8ee-3ffc429131ba req-0b78c3dd-496d-4a4e-9c4f-3236c8bdc1e6 service nova] Creating event network-vif-deleted:d8708285-f641-4742-9fb1-82e4b43a90d6 for instance f981e4bc-3359-49e5-a708-7cbcd570256b on hv-cinder-82099 Jul 19 13:11:03.243857 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-e53dba76-9e2f-43f9-a8ee-3ffc429131ba req-0b78c3dd-496d-4a4e-9c4f-3236c8bdc1e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034005 Jul 19 13:11:03.244844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 966/2073] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 13:11:03.317426 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:03.317953 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:03.326396 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:03.327210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:03.328146 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:03.328881 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:03.369314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:03.369778 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:03.370238 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lazy-loading 'fault' on Instance uuid f981e4bc-3359-49e5-a708-7cbcd570256b {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:11:03.414808 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba1847a4044ae6a338cdb4c80af5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491e79a36d5b4f8cb3952be89ae6c03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:03.425877 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0d8dd181-891f-4235-9ec3-fbf3fdaa443e tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 200 len: 1327 microversion: 2.1 time: 0.111950 Jul 19 13:11:03.426486 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1108/2074] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:03 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:04.443959 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:04.444696 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:04.450875 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:04.451327 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:04.452089 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:04.452563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:04.465355 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] HTTP exception thrown: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Request method failure captured: Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b HTTP/1.1 Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qx4CcuHWw1Ld6PYJRQUbE4_vcvMJuEqsqU8EmOvHDjjQLAF6ZxI37tp_y7Z_uBPhBTMUG3HA1HqPf-NCKlZgGEGo6j_M_Hnpu23gbAibfxE1xbz8Yo9Bzd4vOaWn6wVZcUdRDdSRcesweYPpQ5GDUXnz2d9_p7bFZusUIIpIluauk0 Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:11:04.466934 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_491e79a36d5b4f8cb3952be89ae6c03d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 70ba1847a4044ae6a338cdb4c80af5df Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:04.468340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'f981e4bc-3359-49e5-a708-7cbcd570256b'} Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:11:04.469082 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:04.470338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:04.471940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Returning 404 to user: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:11:04.471940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-41a1b1c2-e720-41fb-a41f-191221c88667 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 404 len: 111 microversion: 2.1 time: 0.028990 Jul 19 13:11:04.471940 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 967/2075] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:04 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:11:04.477364 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3df61a1e-cb5f-42b2-8208-ead6a5ccf4b1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '.version_select at 0x7fd9941d5b80>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:04.495073 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3df61a1e-cb5f-42b2-8208-ead6a5ccf4b1 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813113157" status: 202 len: 0 microversion: 2.1 time: 0.021388 Jul 19 13:11:04.495560 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1109/2076] 10.222.0.13 () {58 vars in 1220 bytes} [Tue Jul 19 13:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813113157 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:11:07.345986 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:07.346962 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:07.353310 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:07.353764 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:07.354527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:07.354968 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:07.368617 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] HTTP exception thrown: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Request method failure captured: Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b HTTP/1.1 Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qx4CcuHWw1Ld6PYJRQUbE4_vcvMJuEqsqU8EmOvHDjjQLAF6ZxI37tp_y7Z_uBPhBTMUG3HA1HqPf-NCKlZgGEGo6j_M_Hnpu23gbAibfxE1xbz8Yo9Bzd4vOaWn6wVZcUdRDdSRcesweYPpQ5GDUXnz2d9_p7bFZusUIIpIluauk0 Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:11:07.370149 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_491e79a36d5b4f8cb3952be89ae6c03d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 70ba1847a4044ae6a338cdb4c80af5df Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.371412 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': 'f981e4bc-3359-49e5-a708-7cbcd570256b'} Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:11:07.372097 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.373296 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.374548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Returning 404 to user: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:11:07.374548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-79d6db29-7e35-413a-9214-f36d940592a2 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 404 len: 111 microversion: 2.1 time: 0.029310 Jul 19 13:11:07.374548 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 968/2077] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:11:07 2022] DELETE /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:11:07.380085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:07.380725 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: f981e4bc-3359-49e5-a708-7cbcd570256b] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:07.387136 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:07.387580 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:07.388407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:07.388845 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:07.401655 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] HTTP exception thrown: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Request method failure captured: Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b HTTP/1.1 Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qx4CcuHWw1Ld6PYJRQUbE4_vcvMJuEqsqU8EmOvHDjjQLAF6ZxI37tp_y7Z_uBPhBTMUG3HA1HqPf-NCKlZgGEGo6j_M_Hnpu23gbAibfxE1xbz8Yo9Bzd4vOaWn6wVZcUdRDdSRcesweYPpQ5GDUXnz2d9_p7bFZusUIIpIluauk0 Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:11:07.403239 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_491e79a36d5b4f8cb3952be89ae6c03d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 70ba1847a4044ae6a338cdb4c80af5df Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.404586 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': 'f981e4bc-3359-49e5-a708-7cbcd570256b'} Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:11:07.405338 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. Jul 19 13:11:07.406612 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:07.407800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Returning 404 to user: Instance f981e4bc-3359-49e5-a708-7cbcd570256b could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:11:07.407800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-feb4d279-3b17-4359-8e2e-10d1d5a20425 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b" status: 404 len: 111 microversion: 2.1 time: 0.028729 Jul 19 13:11:07.407800 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1110/2078] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:07 2022] GET /compute/v2.1/servers/f981e4bc-3359-49e5-a708-7cbcd570256b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:11:08.534021 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:08.534529 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:08.541040 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:08.541496 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:08.542266 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:08.542704 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:08.556071 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] HTTP exception thrown: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Request method failure captured: Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: DELETE /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 HTTP/1.1 Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qx4CcuHWw1Ld6PYJRQUbE4_vcvMJuEqsqU8EmOvHDjjQLAF6ZxI37tp_y7Z_uBPhBTMUG3HA1HqPf-NCKlZgGEGo6j_M_Hnpu23gbAibfxE1xbz8Yo9Bzd4vOaWn6wVZcUdRDdSRcesweYPpQ5GDUXnz2d9_p7bFZusUIIpIluauk0 Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:11:08.557546 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_491e79a36d5b4f8cb3952be89ae6c03d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 70ba1847a4044ae6a338cdb4c80af5df Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.558901 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '529d0843-a3f3-4095-8586-1049ce771a18'} Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:11:08.562217 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.563469 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.564750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Returning 404 to user: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:11:08.564750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-cc4234f2-f2f8-488c-893c-46e5f4a58610 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "DELETE /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 404 len: 111 microversion: 2.1 time: 0.029014 Jul 19 13:11:08.564750 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 969/2079] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:11:08 2022] DELETE /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:11:08.567574 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:08.568224 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] [instance: 529d0843-a3f3-4095-8586-1049ce771a18] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:08.574643 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:08.575084 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:08.575835 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:08.576289 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:08.589177 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] HTTP exception thrown: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Request method failure captured: Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 HTTP/1.1 Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept: application/json Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Connection: close Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Host: 10.222.0.13 Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABi1qx4CcuHWw1Ld6PYJRQUbE4_vcvMJuEqsqU8EmOvHDjjQLAF6ZxI37tp_y7Z_uBPhBTMUG3HA1HqPf-NCKlZgGEGo6j_M_Hnpu23gbAibfxE1xbz8Yo9Bzd4vOaWn6wVZcUdRDdSRcesweYPpQ5GDUXnz2d9_p7bFZusUIIpIluauk0 Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jul 19 13:11:08.590644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_491e79a36d5b4f8cb3952be89ae6c03d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/491e79a36d5b4f8cb3952be89ae6c03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 491e79a36d5b4f8cb3952be89ae6c03d Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1416373952 Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Id: 70ba1847a4044ae6a338cdb4c80af5df Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeTestJSON-1416373952-project Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: method: > Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: exception: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.591774 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: action_args: {'id': '529d0843-a3f3-4095-8586-1049ce771a18'} Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:11:08.592408 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. Jul 19 13:11:08.593341 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jul 19 13:11:08.594400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] Returning 404 to user: Instance 529d0843-a3f3-4095-8586-1049ce771a18 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:11:08.594400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f907aa33-9772-4eb9-b30d-f5920b376e02 tempest-AttachVolumeTestJSON-1416373952 tempest-AttachVolumeTestJSON-1416373952-project] 10.222.0.13 "GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18" status: 404 len: 111 microversion: 2.1 time: 0.028847 Jul 19 13:11:08.594400 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1111/2080] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:08 2022] GET /compute/v2.1/servers/529d0843-a3f3-4095-8586-1049ce771a18 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 13:11:49.560580 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:11:49.561160 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:49.563333 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=22 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:11:49.563994 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:11:49.569896 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:49.570344 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:49.571098 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:49.571559 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:49.597924 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.objects.instance [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lazy-loading 'flavor' on Instance uuid 624e91cb-5f7c-4803-b0f8-763a0ff208df {{(pid=118119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:11:49.667992 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-c276119d-21d9-41af-9398-45c59356eec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "POST /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df/action" status: 202 len: 0 microversion: 2.1 time: 0.111068 Jul 19 13:11:49.668624 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 970/2081] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:11:49 2022] POST /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:11:49.677613 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:49.678219 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:49.680445 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:11:49.681210 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:11:49.687046 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:49.687493 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:49.688291 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:49.688732 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:49.823452 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:49.831474 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c7b4f3bb-a4b5-47c7-83cb-5bded85aeb37 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.158378 Jul 19 13:11:49.832039 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1112/2082] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:49 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:11:50.851271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:50.851970 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:50.858137 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:50.858590 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:50.859350 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:50.859791 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:50.987867 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:50.995377 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-07ff84be-97d9-4136-a96e-9cd00d966062 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.148927 Jul 19 13:11:50.995944 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 971/2083] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:50 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:52.012444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:52.013081 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:52.020441 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:52.020892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:52.021644 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:52.022076 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:52.151695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:52.159095 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98e1cbd4-525e-47a4-b7ea-2841f866f19a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.150625 Jul 19 13:11:52.159653 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1113/2084] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:52 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 13:11:53.175967 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:53.176614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:53.182963 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:53.183415 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:53.184169 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:53.184626 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:53.313490 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:53.321424 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7844d21e-d9fd-437c-9526-39c0ce56ce56 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.149344 Jul 19 13:11:53.321987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 972/2085] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:53 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:54.338920 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:54.339528 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:54.346527 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:54.346970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:54.347723 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:54.348150 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:54.477610 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:54.485027 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43011e6a-086d-4155-bba2-1af528c4f8e6 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.150181 Jul 19 13:11:54.485594 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1114/2086] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:54 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:55.501839 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:55.502445 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:55.508820 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:55.509271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:55.510026 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:55.510458 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:55.644950 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:55.654851 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-2383a9d9-3b0e-46b9-9bbf-bf1b86cacf73 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.156824 Jul 19 13:11:55.655536 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 973/2087] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:55 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:56.672074 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:56.672715 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:56.679531 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:56.679978 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:56.680769 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:56.681201 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:56.809271 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:56.816710 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a38a2423-bd46-44d7-b226-d2b3d347caae tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.148436 Jul 19 13:11:56.817267 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1115/2088] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:56 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:57.834398 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:57.835014 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:57.841430 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:57.841889 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:57.842645 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:57.843093 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:57.973935 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:57.981247 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-7f2e8237-837e-47d6-ad02-e532742bb55a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.150734 Jul 19 13:11:57.981809 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 974/2089] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:57 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:11:58.998232 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:11:58.998876 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:11:59.005323 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:59.005775 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:59.006532 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:11:59.006966 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:11:59.133649 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:11:59.141213 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0b3deed-e030-460f-b660-7bf1c128f0aa tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.146871 Jul 19 13:11:59.141784 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1116/2090] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:11:58 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:00.159188 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:00.159800 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:00.166295 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:00.166744 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:00.167508 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:00.167942 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:00.297761 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:00.306131 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-5dcab96a-ea4c-4e40-aab8-db09dca1907a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.151196 Jul 19 13:12:00.306714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 975/2091] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:00 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:01.322085 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:01.322692 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:01.329179 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:01.329623 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:01.330371 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:01.330797 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:01.461729 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:01.469183 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f81e8444-c0fc-4130-b6a5-f17262e8c163 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.150885 Jul 19 13:12:01.469740 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1117/2092] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:01 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:02.486263 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:02.487158 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:02.493657 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:02.494103 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:02.494861 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:02.495292 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:02.624432 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:02.632410 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-665de52f-cde7-4be3-a3a2-877410a961d2 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1509 microversion: 2.1 time: 0.150431 Jul 19 13:12:02.632987 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 976/2093] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:02 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:02.648735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30288e86-8e16-418a-b9b9-f75e4267e0eb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:12:02.649298 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30288e86-8e16-418a-b9b9-f75e4267e0eb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:02.655616 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30288e86-8e16-418a-b9b9-f75e4267e0eb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:02.656065 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30288e86-8e16-418a-b9b9-f75e4267e0eb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:02.656857 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30288e86-8e16-418a-b9b9-f75e4267e0eb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:02.657292 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30288e86-8e16-418a-b9b9-f75e4267e0eb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:02.742431 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30288e86-8e16-418a-b9b9-f75e4267e0eb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "POST /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df/action" status: 202 len: 0 microversion: 2.1 time: 0.097397 Jul 19 13:12:02.743036 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1118/2094] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jul 19 13:12:02 2022] POST /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:12:02.751069 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:02.752244 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:02.758054 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:02.758511 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:02.759274 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:02.759711 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:02.895106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:02.902714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-034f3c14-ca8e-489c-a608-295484de48b8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1517 microversion: 2.1 time: 0.155544 Jul 19 13:12:02.903277 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 977/2095] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:02 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:03.920276 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:03.920894 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:03.928695 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:03.929148 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:03.929904 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:03.930334 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:04.063509 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:04.072131 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4498dd39-9d7c-464c-826c-5aa4439f59ce tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1519 microversion: 2.1 time: 0.155709 Jul 19 13:12:04.072830 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1119/2096] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:03 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:05.089693 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:05.090303 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:05.096714 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:05.097163 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:05.097919 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:05.098357 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:05.229053 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:05.236443 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-4b998d64-ad0d-4462-8490-fe3d7a7bf308 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1575 microversion: 2.1 time: 0.150606 Jul 19 13:12:05.237003 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 978/2097] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:05 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:06.030948 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-cf4ba54e-07db-4b63-ba7a-cad70a1bf591 req-1bc71dba-6c2b-427b-9107-5438583f605e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624e91cb-5f7c-4803-b0f8-763a0ff208df", "name": "network-vif-unplugged", "status": "completed", "tag": "6b6adb28-9a6c-48ce-80b9-619e1d832e83"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:12:06.039973 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-cf4ba54e-07db-4b63-ba7a-cad70a1bf591 req-1bc71dba-6c2b-427b-9107-5438583f605e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:06.040450 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-cf4ba54e-07db-4b63-ba7a-cad70a1bf591 req-1bc71dba-6c2b-427b-9107-5438583f605e service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:06.053159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-cf4ba54e-07db-4b63-ba7a-cad70a1bf591 req-1bc71dba-6c2b-427b-9107-5438583f605e service nova] Creating event network-vif-unplugged:6b6adb28-9a6c-48ce-80b9-619e1d832e83 for instance 624e91cb-5f7c-4803-b0f8-763a0ff208df on hv-cinder-82099 Jul 19 13:12:06.058420 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-cf4ba54e-07db-4b63-ba7a-cad70a1bf591 req-1bc71dba-6c2b-427b-9107-5438583f605e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031229 Jul 19 13:12:06.059020 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1120/2098] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:12:06.253555 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:06.254191 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:06.260132 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:06.260612 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:06.261363 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:06.261799 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:06.390876 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:06.398969 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-8572a6e3-7f12-4ca1-b5c0-becb0143049f tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1575 microversion: 2.1 time: 0.149451 Jul 19 13:12:06.399534 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 979/2099] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:06 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:07.417314 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:07.417933 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:07.424669 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:07.425113 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:07.425861 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:07.426288 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:07.556325 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:07.563701 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94a6d471-98d0-4d8f-8981-831fe3981afb tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1575 microversion: 2.1 time: 0.151067 Jul 19 13:12:07.564283 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1121/2100] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:07 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:08.580682 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:08.581216 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:08.588083 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:08.588582 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:08.589352 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:08.589795 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:08.719873 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:08.727288 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-76ffe64b-e603-4d7c-ac4f-07b129f77c2a tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1575 microversion: 2.1 time: 0.150721 Jul 19 13:12:08.727852 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 980/2101] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:08 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:09.744280 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:09.744892 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:09.751818 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:09.752295 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:09.753049 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:09.753483 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:09.879405 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:09.886822 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1fbb5f78-63db-4aca-918f-6d3a4bc20471 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1575 microversion: 2.1 time: 0.146422 Jul 19 13:12:09.887381 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1122/2102] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:09 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:10.905244 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:10.905858 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:10.913110 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:10.913563 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:10.914325 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:10.914767 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:11.047389 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:11.054848 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-b6d079e9-63f1-4eb8-9754-102b0d025443 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1575 microversion: 2.1 time: 0.153768 Jul 19 13:12:11.055436 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 981/2103] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:10 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:12.073951 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:12:12.074603 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:12:12.082116 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:12.082589 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:12.083718 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:12.084253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:12.226553 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:12:12.234515 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a90587b1-8780-4c21-954d-8d5b1f4509c5 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1562 microversion: 2.1 time: 0.165033 Jul 19 13:12:12.235152 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1123/2104] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:12:12 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:12:14.118268 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-42cea200-2606-4c6c-9e94-8338fb15a076 req-73069aec-3f6c-4b0c-9dd6-12a6bb6184ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624e91cb-5f7c-4803-b0f8-763a0ff208df", "name": "network-vif-plugged", "status": "completed", "tag": "6b6adb28-9a6c-48ce-80b9-619e1d832e83"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:12:14.127513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-42cea200-2606-4c6c-9e94-8338fb15a076 req-73069aec-3f6c-4b0c-9dd6-12a6bb6184ee service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:12:14.128271 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-42cea200-2606-4c6c-9e94-8338fb15a076 req-73069aec-3f6c-4b0c-9dd6-12a6bb6184ee service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:12:14.139380 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-42cea200-2606-4c6c-9e94-8338fb15a076 req-73069aec-3f6c-4b0c-9dd6-12a6bb6184ee service nova] Creating event network-vif-plugged:6b6adb28-9a6c-48ce-80b9-619e1d832e83 for instance 624e91cb-5f7c-4803-b0f8-763a0ff208df on hv-cinder-82099 Jul 19 13:12:14.144726 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-42cea200-2606-4c6c-9e94-8338fb15a076 req-73069aec-3f6c-4b0c-9dd6-12a6bb6184ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030119 Jul 19 13:12:14.145314 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 982/2105] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:12:35.202338 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:12:35.203017 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:12:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:12:56.389844 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:12:56.390340 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:13:28.395785 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:13:28.396444 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:13:28.846562 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_api:SELECT=26 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:13:28.847064 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:13:28.847203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:13:28.847527 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG dbcounter [-] [118119] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:13:28.851860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=26 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:13:28.852549 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:13:28.852681 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-a37b44e2-a2ef-4dd6-8a31-cee78b294e95 req-172f08ee-792f-4a78-ae74-253f3d5b6110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624e91cb-5f7c-4803-b0f8-763a0ff208df", "tag": "6b6adb28-9a6c-48ce-80b9-619e1d832e83"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:13:28.857159 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:28.857620 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:28.858802 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:28.859160 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:28.863516 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-a37b44e2-a2ef-4dd6-8a31-cee78b294e95 req-172f08ee-792f-4a78-ae74-253f3d5b6110 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:28.864095 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-a37b44e2-a2ef-4dd6-8a31-cee78b294e95 req-172f08ee-792f-4a78-ae74-253f3d5b6110 service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:28.875712 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-a37b44e2-a2ef-4dd6-8a31-cee78b294e95 req-172f08ee-792f-4a78-ae74-253f3d5b6110 service nova] Creating event network-changed:6b6adb28-9a6c-48ce-80b9-619e1d832e83 for instance 624e91cb-5f7c-4803-b0f8-763a0ff208df on hv-cinder-82099 Jul 19 13:13:28.881060 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-a37b44e2-a2ef-4dd6-8a31-cee78b294e95 req-172f08ee-792f-4a78-ae74-253f3d5b6110 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036405 Jul 19 13:13:28.882167 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 983/2106] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:13:28.886972 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 13:13:28.976860 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4ed6cb92-759e-4884-9baf-66cd6f566d29 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "DELETE /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 204 len: 0 microversion: 2.1 time: 0.134416 Jul 19 13:13:28.987388 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:13:28.988481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:13:28.991542 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1124/2107] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jul 19 13:13:28 2022] DELETE /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 13:13:28.995112 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:28.995649 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:28.996591 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:28.997106 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:29.230334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.policy [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118119) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:13:29.237898 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-bed8a8e3-60bb-4553-ab16-b3103f3b6dcd tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.254631 Jul 19 13:13:29.238679 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 984/2108] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:13:28 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:13:30.255582 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:13:30.256253 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:13:30.264130 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:30.264619 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:30.265404 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:30.265843 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:30.463380 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:13:30.470915 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dee889d2-7759-4a14-9f71-97adc4e32484 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1568 microversion: 2.1 time: 0.219683 Jul 19 13:13:30.471674 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1125/2109] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:13:30 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:13:30.906335 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [req-66dd8031-cde4-4534-bd99-1c46fa9236c6 req-654892d1-07ad-4f00-868e-8af7dff727cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624e91cb-5f7c-4803-b0f8-763a0ff208df", "name": "network-vif-deleted", "tag": "6b6adb28-9a6c-48ce-80b9-619e1d832e83"}]} {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 13:13:30.918982 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-66dd8031-cde4-4534-bd99-1c46fa9236c6 req-654892d1-07ad-4f00-868e-8af7dff727cc service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:30.919642 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [req-66dd8031-cde4-4534-bd99-1c46fa9236c6 req-654892d1-07ad-4f00-868e-8af7dff727cc service nova] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:30.938194 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.compute.server_external_events [req-66dd8031-cde4-4534-bd99-1c46fa9236c6 req-654892d1-07ad-4f00-868e-8af7dff727cc service nova] Creating event network-vif-deleted:6b6adb28-9a6c-48ce-80b9-619e1d832e83 for instance 624e91cb-5f7c-4803-b0f8-763a0ff208df on hv-cinder-82099 Jul 19 13:13:30.943840 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [req-66dd8031-cde4-4534-bd99-1c46fa9236c6 req-654892d1-07ad-4f00-868e-8af7dff727cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043390 Jul 19 13:13:30.944680 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 985/2110] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jul 19 13:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 13:13:31.488087 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:13:31.488734 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:13:31.495705 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:31.496156 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:31.496970 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:31.497417 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:31.526384 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:31.526831 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:31.527277 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lazy-loading 'fault' on Instance uuid 624e91cb-5f7c-4803-b0f8-763a0ff208df {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 13:13:31.570735 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97565560b942439c9c4c09bf3097b8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de65ab2754b49d69c41eb4d2870648e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 13:13:31.578641 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6fb9774-11eb-4861-946c-4eef7104c590 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 200 len: 1224 microversion: 2.1 time: 0.094382 Jul 19 13:13:31.579287 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1126/2111] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:13:31 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 13:13:32.598369 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '>' {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:13:32.599119 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.compute.api [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] [instance: 624e91cb-5f7c-4803-b0f8-763a0ff208df] Fetching instance by UUID {{(pid=118119) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 13:13:32.605360 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:32.605815 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:32.606585 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 13:13:32.607025 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG oslo_concurrency.lockutils [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Lock "13ce8bd2-84ca-4c65-9066-7f515d1d3ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 13:13:32.620849 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.wsgi [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] HTTP exception thrown: Instance 624e91cb-5f7c-4803-b0f8-763a0ff208df could not be found. Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Request method failure captured: Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: request: GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df HTTP/1.1 Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept: application/json Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Accept-Encoding: identity Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Connection: close Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Length: 0 Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Content-Type: application/json Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Host: 10.222.0.13 Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Openstack-System-Scope: None Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: User-Agent: python-urllib3/1.26.9 Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Auth-Token: gAAAAABi1qz6L8cuR4pvM5gl_vmM8dZofW3x7SedpuicvbLwbLVFJplQpkqbH27_-iZ7gcVOHAYY8KnEJUeo9dZrnERDDSiFX2xRMD2V_rp0y8SieugSUfVnvxUlcK9BP7wIv2c5XTikI1nG6iC_Dj09P9fTwHVUkXKyq1x8tUjc34jiPdCFUl0 Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Id: None Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Domain-Name: None Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Identity-Status: Confirmed Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Is-Admin-Project: True Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Id: default Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Domain-Name: Default Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Id: 3de65ab2754b49d69c41eb4d2870648e Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Project-Name: tempest-TestShelveInstance-1463164814 Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Role: reader,member Jul 19 13:13:32.622481 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Roles: reader,member Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3de65ab2754b49d69c41eb4d2870648e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3de65ab2754b49d69c41eb4d2870648e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3de65ab2754b49d69c41eb4d2870648e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3de65ab2754b49d69c41eb4d2870648e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant: tempest-TestShelveInstance-1463164814 Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Id: 3de65ab2754b49d69c41eb4d2870648e Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-Tenant-Name: tempest-TestShelveInstance-1463164814 Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User: tempest-TestShelveInstance-1463164814-project Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Id: default Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Domain-Name: Default Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Id: 97565560b942439c9c4c09bf3097b8c8 Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: X-User-Name: tempest-TestShelveInstance-1463164814-project Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: method: > Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: exception: Instance 624e91cb-5f7c-4803-b0f8-763a0ff208df could not be found. Jul 19 13:13:32.623611 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: action_args: {'id': '624e91cb-5f7c-4803-b0f8-763a0ff208df'} Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: {{(pid=118119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624e91cb-5f7c-4803-b0f8-763a0ff208df could not be found. Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 13:13:32.624334 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624e91cb-5f7c-4803-b0f8-763a0ff208df could not be found. Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624e91cb-5f7c-4803-b0f8-763a0ff208df could not be found. Jul 19 13:13:32.625614 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: ERROR nova.api.openstack.wsgi Jul 19 13:13:32.626789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: DEBUG nova.api.openstack.wsgi [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Returning 404 to user: Instance 624e91cb-5f7c-4803-b0f8-763a0ff208df could not be found. {{(pid=118119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 13:13:32.626789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO nova.api.openstack.requestlog [None req-d410e61b-be6c-4934-9598-b67ebafad155 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df" status: 404 len: 111 microversion: 2.1 time: 0.030178 Jul 19 13:13:32.626789 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: [pid: 118119|app: 0|req: 986/2112] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jul 19 13:13:32 2022] GET /compute/v2.1/servers/624e91cb-5f7c-4803-b0f8-763a0ff208df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 13:13:32.778245 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fba22bb-b5ff-4532-ac4d-c9a6e4031ec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] Calling method '.version_select at 0x7fd998109af0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 13:13:32.801319 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fba22bb-b5ff-4532-ac4d-c9a6e4031ec8 tempest-TestShelveInstance-1463164814 tempest-TestShelveInstance-1463164814-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1779728470" status: 202 len: 0 microversion: 2.1 time: 0.026835 Jul 19 13:13:32.806203 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1127/2113] 10.222.0.13 () {58 vars in 1253 bytes} [Tue Jul 19 13:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1779728470 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 13:14:34.312355 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:14:34.313024 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:15:55.212513 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:15:55.213092 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:15:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:16:16.399047 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:16:16.399816 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:16:24.210702 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:16:24.211236 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:16:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:16:48.406976 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:16:48.407742 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:17:54.320407 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:17:54.321118 dv-cinder-820994-4-iscsi devstack@n-api.service[118120]: Tue Jul 19 13:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 13:18:35.322258 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 13:18:35.322869 dv-cinder-820994-4-iscsi devstack@n-api.service[118119]: Tue Jul 19 13:18:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!